
Go to the dogs
Negative Connotation
The phrase suggests a decline with a sense of regret or disappointment. 
Not for People
Typically used for places or institutions, rather than individuals. 
Informal Usage
It's commonly used in casual conversations, not in formal writing. 