
Wash your hands of somebody/something
Metaphorical Cleanse
Imagine washing dirt off your hands to feel the sense of removing something undesired or troublesome. 
Not Always Negative
The phrase can be neutral, not implying that the person or thing is bad, but that you no longer wish to be involved. 
Emotionally Charged
Using this phrase can show strong emotions such as frustration or relief after distancing oneself. 