Ya I think its fine in most cases but not when you just had a passed ball and have a runner at 3B.
Anyways, I think its fine to have different viewpoints on this as there are a lot of factors to consider.
Buck's point was that there's a runner on 3B where a wild pitch let's in a run. You should adjust your stances based on the situation in the game, especially when there was already a wild pitch a few batters before.