The phrase can imply emotional or psychological barriers, not just physical ones. Don't let pride get in the way of asking for help when you need it.
Pro Tip 2/3
Non-literal Meaning
Sometimes used metaphorically to describe intangible hurdles such as beliefs or rules. Superstitions can sometimes get in the way of scientific understanding.
Pro Tip 3/3
Emotional Connotation
Often suggests a negative impact by implying potential unfulfilled due to obstacles. Don't let jealousy get in the way of your friendships.