Bugger about
Definition 1 of 2
Pro Tip 1/3British Colloquialism
Mainly used in the UK, may not be understood elsewhere. 
When I was in the States, no one got it when I said I was 'buggering about' in the shop.
Pro Tip 2/3Informal Setting
Suitable for casual conversations, not in formal situations. 
Chatting with mates, you can say 'I’ve just been buggering about all day.'
Pro Tip 3/3Negative Connotation
Often expresses irritation or disapproval at wasting time. 
The boss noticed Sam was buggering about instead of finishing reports.