Frenzied Fugue says this:
Enchantment — Aura
Enchant permanent
When Frenzied Fugue enters the battlefield or at the beginning of your upkeep, gain control of enchanted permanent until end of turn. Untap that permanent. It gains haste until end of turn.
If I enchant a permanent controled by my opponent, then make the Frenzied Fugue leave the battlefield (by sacrificing it, destroying, etc.), do I lose the control of the permanent at the end of the turn?