Yeah that is my thought process. The umpires try to take control of the game enough as it is, imagine how bitter they would be about getting called on it. So you have an ump already doing a s***** job and now he's pissed at you / knows he can get away with practically anything because he's an umpire.