Use 'count against' to express that something is a disadvantage or harms someone's chances. His tardiness might count against him when he asks for a promotion.
Pro Tip 2/3
Job Competitions
'Count against' is often used when discussing qualifications or performance in jobs and competitions. In the cooking contest, the presentation of the dish counted against her.
Pro Tip 3/3
Subjectivity
What 'counts against' someone can be subjective and vary depending on the situation or person judging. For some voters, a candidate's lack of local experience counts against them.