Make yourself scarce
Definition 1 of 1
Pro Tip 1/3Avoiding Trouble
Use the phrase when you anticipate problems and decide to leave before they affect you. 
Once the debate started getting heated, I made myself scarce.
Pro Tip 2/3Stealthy Exit
It suggests leaving quietly without attracting attention, almost like a ninja! 
The party got boring, so I made myself scarce without anyone noticing.
Pro Tip 3/3Sudden Disappearance
It can imply a sudden or unexpected departure from a place. 
Right before doing the dishes, my roommate made himself scarce.