
Throw the baby out with the bathwater
Metaphor Origin
The phrase comes from a time when water was scarce, so the baby's bath was last, and dirtiest. 
Negative Connotation
The phrase often implies a careless or thoughtless mistake, not a deliberate choice. 
Cautionary Advice
Used as a warning to consider the value of what you're getting rid of. 