Not only that, but there is a significant risk of pulling an effective pitcher for another, not knowing if the new pitcher will be effective or not. Some days, a pitcher just does not have it. As we all know, there is a significant variation in pitcher performance from start to start, appearance to appearance.
If you use analytics (i.e., statistical probabilities) to come up with a predetermined strategy, but don't adjust it based on real time data, you aren't using analytics properly.