Benefit of the Doubt: The Cruel Umpire

In last week's episode of Benefit of the Doubt, I put my own spin on the interesting phenomena of the "compassionate umpire." Essentially, as the count becomes more favorable to the hitter, the strike zone grows and the zone advantage increases.

We can measure this trend by comparing zone advantage to the run expectancy of the count. This relationship, illustrated below, is linear and statistically significant: as the run expectancy increases, so does the zone advantage (data borrowed from Jeremy Greenhouse at Baseball Analysts).


Knowing this, my working hypothesis was that the same trend applied to base-out states. For the uninitiated, base-out state describes the combination of outs and bases occupied. Since there are three out states and eight base states (empty, 1st, 2nd, 3rd, 1st & 2nd, 1st & 3rd, 2nd & 3rd, loaded), there are twenty-four base-out states.

For each of these states there is a particular run expectancy—the average number of runs expected to score in the inning—as calculated here by Tom Tango at Inside the Book.

As it turns out, my working hypothesis was not only rejected, but turned on its head entirely. My working model indicates that the umpire actually becomes less forgiving as the run value of the base-out state increases. See the chart below:


Out states are represented by color, while the base state is represented as text (bases empty = ___ ; runners at the corners = x_x ; bases loaded = xxx). As you can see, the relationship is nearly the perfect inverse of the one we observe with ball-strike count. As the run value of the base-out state increases, the zone actually becomes less favorable to the pitcher; the umpire is cruel instead of compassionate.

The effect is also visible on strike zone heat maps. See below the effect of out states on the zone (click to enlarge):


And also base state:


For a more succinct illustration, the most favorable base state for pitchers vs. the least favorable:


In each case, the zone shrinks as the base-out state gets worse for the pitcher and better than the hitter.

Bearing witness to this effect, the bigger question is "Why?" Well, I have absolutely no idea why, but the effect exists both independently and controlling for other relevant variables.

The umpire giveth, and the umpire taketh away.

PitchF/X data originate from Darrell Zimmerman's SQL-based PitchFX database, run expectancy data by Tom Tango at Inside the Book and Jeremy Greenhouse at Baseball Analysts. Special thanks to Mike Fast for his advisement prior to posting.


Previous episodes in the Benefit of the Doubt series:

SB Nation Featured Video
Log In Sign Up

Log In Sign Up

Forgot password?

We'll email you a reset link.

If you signed up using a 3rd party account like Facebook or Twitter, please login with it instead.

Forgot password?

Try another email?

Almost done,

By becoming a registered user, you are also agreeing to our Terms and confirming that you have read our Privacy Policy.

Join Beyond the Box Score

You must be a member of Beyond the Box Score to participate.

We have our own Community Guidelines at Beyond the Box Score. You should read them.

Join Beyond the Box Score

You must be a member of Beyond the Box Score to participate.

We have our own Community Guidelines at Beyond the Box Score. You should read them.




Choose an available username to complete sign up.

In order to provide our users with a better overall experience, we ask for more information from Facebook when using it to login so that we can learn more about our audience and provide you with the best possible experience. We do not store specific user data and the sharing of it is not required to login with Facebook.