take him to task

Take him to task is another way to say you have scolded or reprimanded someone. It is usually spoken to someone who you feel should scold someone else for doing something wrong or against the rules, not necessarily when speaking in past tense, however it can be spoken during both occasions. It is simply another way to say you want someone to be reprimanded for something they did that was not allowed.