Use when something pleasantly surprises you because it's not what's typically encountered. The magic show was out of the ordinary, leaving everyone in awe.
Pro Tip 2/3
Cultural Nuances
What's ordinary can vary by culture, so the phrase may highlight cultural differences. Wearing shoes indoors is out of the ordinary in some countries.
Pro Tip 3/3
Not Always Positive
It's not always positive; it can imply strangeness or unfamiliarity which may not be welcome. His approach to teaching was out of the ordinary and unsettled some students.