Unholy DKs, how do you Death Pact your Gargoyle while your Ghoul is up?

Seems even if I specifically target my Gargoyle when pressing Death Pact, the game will pick my Ghoul to be sacrificed instead.
The only times I can successfully consume a Gargoyle is when my Ghoul is not around.