
Take French leave
Sneaky Exit
Implies a sly or secret departure. Used when someone wants to avoid attention or leave unnoticed. 
Potentially Rude
Can be viewed as impolite because it looks like you don't respect the host or the meeting organizer enough to inform them. 
Invisible Guest
Used in social situations where a person joins or leaves a gathering without attracting any attention. 