Somebody’s heart is in the right place
Definition 1 of 1
Pro Tip 1/3Good Intentions
Focuses on someone's positive intentions, despite the outcome of their actions. 
He donated to the wrong charity, but his heart is in the right place.
Pro Tip 2/3Not about Success
Used when someone's efforts or methods fail, but their desire to help is acknowledged. 
She tried to bake a cake for the fundraiser, but it fell flat. Still, her heart is in the right place.
Pro Tip 3/3Not Literal
It's a metaphorical phrase and doesn't refer to the actual location of the heart in one's body. 
Don't be confused; 'his heart is in the right place' means he's trying to be kind, not that his heart has moved.