
Get a rise out of somebody
Intent Matters
This use often implies playful or mischievous intent rather than a desire to truly upset someone. 
Informal Contexts
Typically used in informal settings among friends or family, not in professional environments. 
Degree of Annoyance
The reaction sought is usually mild annoyance, so the phrase is not used for serious provocation. 