
Bring up the rear
Physical Position
Often refers to actual physical location, being the last in line. 
Not Negative
The phrase isn't always negative; it can just state a fact, without implying failure. 
Idiomatic Usage
Understand it's an idiom; don't interpret it literally, like physically moving someone's rear. 