clock menu more-arrow no yes mobile

Filed under:

Saber-Friendly Blogging 101: Making Sense of Defense

Continuing with Sky's Saber-Friendly Blogging 101 Series, this installment will focus on an issue of baseball sabermetrics that is likely gaining popularity not only on the internet but major league front offices as well; at least by judging the contracts handed out to players like Pat Burrell and Jason Giambi this offseason. I'm talking of course about defense.

I guess I should make a bit of an introduction first. My name is Graham Goldbeck, and I run the blog Oaktown Awesomer's. My contributions to BtB thus far have pretty much just been Oakland A's MS Paint drawings. But my true role besides the occasional story is sort of a quasi Fanshot director. So if any of you out there have an interesting blog which I can read and post links to when I find interesting articles/pictures, go ahead and post a link below or shoot me an email with a link, my email is at the bottom of the site.

But back to defense, and how it has been quantified over the years. For a long time, probably all the way back to Henry Chadwick's invention of the box score, the statistic which players' defense was measured by was the big E, or errors. Many a contract and/or Gold Glove was handed out based on the fact that (insert random player) committed the fewest errors or had the highest Fielding Percentage, so he must be an awesome fielder. But is this really true?

 

 

No. Well, there probably is some correlation between a player's number of errors committed and his fielding ability, but it is no where near as strong as it has been made out to be over the years. Just a quick anecdotal problem can show why this is false.

Say you have two 2B, one with exceptional range who makes the occasional poor throw to first base. Then you have another 2B with awful range but who makes perfect throws to first base everytime. 100 balls are hit in in the exact same way to both fielders in 300 innings. The first fielder fields 88 of them but makes 5 errant throws. The second fielder fields 58 of them but throws them all to first cleanly. Which 2B would you rather have? I would hope everyone said the first, as he's the much better fielder. This is just one reason why errors are very problematic in evaluating defense, and I haven't even addressed things like Official Scorer Bias (when is an error an error?), or that all errors are certainly not equal.

The situation I posted above is another defensive statistic that has been around for a while, Range Factor. Created by Bill James, it's simply Assists + Putouts / Innings Played. While its an improvement over errors, it too has glaring problems, like favoring infielders on teams with groundball heavy pitching staffs (they'd have many more opportunities for fielding plays) or players on teams with very low strikeout pitchers (more balls put into play).

Another stat which can be useful in evaluating team defense is the Defensive Efficiency Rating (DER). This is how many balls that are put into play are turned into outs. The quick and easy was to do this is 1- Team BABIP, but the full formula is:

1 - ((H + ROE - HR) / (PA - BB - SO - HBP - HR)).

It is helpful in measuring team defense, but again falls short, in this case by favoring teams with flyball heavy pitching staffs (less likely for a flyball to go for a hit unless its a HR, which is subtracted from the equation) and assuming all balls hit into play are equally likely to be fielded.

But the search for defensive evaluation has kept evolving, and has manifested itself most recently -especially with the aid of play by play data- in zone based defensive ratings. In a zone rating metric, there are general areas in the field of play a given fielder is "responsible" for fielding balls in.

Zrgrid_medium

via www.baseballthinkfactory.org

This is the STATS Inc. Zone Rating Grid, which the Zone Rating (ZR) defensive statistic is based off. I mention STATs Inc. because their baseball charting data is different than that of Baseball Info Solutions (BIS), the other large baseball data provider. More stats are based off the BIS data, including John Dewan's Plus/Minus (subscription to Bill James Online needed), David Pinto's Probabilistic Model of Range (PMR) and Michael Lichtman's Ultimate Zone Rating (UZR).

Each of these systems has their own pluses and minuses (haha!), and I won't get into a large debate about them here. The important thing they all do that ZR does not is adjust for balls in a given zone that are not considered fieldable (whether it by by location, speed, trajectory, etc). How they do that I believe varies by system.

These systems have their own shortcomings too, they don't address an outfielder's arm strength or infielders ability to turn a DP. But they are currently (as far as I know) the best defensive stats publicly available.

Ideas for a team specific article:

  • Explain why your team's error total may not be a good indicator of team defensive prowess. Maybe do the same for some of your team's players.
  • Post various defensive statistics for players on your team in a chart and compare how the different statistics evaluate each player (any huge discrepancies like Andruw Jones?)
  • Take a crack at explaining what defensive shortcomings your team or a specific player on it might have and how they can overcome it (if possible). This suggestion is a little less sabermetric-y, but you can still use things like balls fielded above/below average in your analysis.
  • See if there are any Free Agents out there who may improve your team who may be "undervalued" because of their defense.

To get things rolling a bit for discussion, here's a chart of a bunch of various defensive statistics teams compiled in 2008.

Note: This chart is sorted by UZR/150, and fielding +/- is in plays.

 

Team E FP DP Def Eff. Fldng +/- PMR RAA/4000 UZR/150
Rays 90 0.985 429 0.708 24 30.9 9.5
Phillies 90 0.985 380 0.695 52 -14.2 6.7
Red Sox 85 0.986 399 0.698 7 28 6.1
Athletics 98 0.984 467 0.699 20 28 4.3
Astros 67 0.989 379 0.697 26 24.3 4.1
Cardinals 85 0.986 430 0.694 58 13.5 3.8
Nationals 123 0.98 387 0.686 5 -23.2 3.9
Brewers 101 0.984 425 0.7 59 22.7 2.9
Giants 96 0.984 341 0.685 -32 -8.9 3
Royals 96 0.984 431 0.688 -33 -39 2.5
Blue Jays 84 0.986 366 0.703 72 51.3 2.6
Mets 83 0.986 344 0.699 25 -15.1 2
Cubs 99 0.983 311 0.703 28 8.8 1.4
Indians 94 0.985 498 0.685 -1 1.7 0.8
Marlins 117 0.98 328 0.692 2 -1.3 0.1
Angels 91 0.985 441 0.691 -5 23.8 -0.1
Braves 107 0.983 404 0.692 29 38.9 -0.1
Orioles 100 0.983 441 0.687 -27 -24.3 -0.3
Padres 85 0.986 401 0.694 16 -19.3 -1.9
Pirates 107 0.983 504 0.694 -32 -21.8 -2.3
White Sox 108 0.983 427 0.686 5 -0.8 -2.4
Twins 108 0.983 465 0.684 -11 5.8 -3.2
Diamondbacks 113 0.981 374 0.685 -27 -2.9 -3.5
Mariners 99 0.984 430 0.679 -46 4.5 -4.2
Dodgers 101 0.984 376 0.69 8 10.8 -4.9
Rangers 132 0.979 528 0.666 -61 -17.6 -4.5
Tigers 113 0.981 466 0.683 -54 -11.4 -4.9
Yankees 83 0.986 366 0.682 -30 -26.5 -5.2
Reds 114 0.981 414 0.671 -53 -34.6 -5.8
Rockies 96 0.985 466 0.677 -21 -22.5 -9.1

 

One last thing:

If all this defensive info still sounds like mumbo-jumbo, one stat which everyone can get involved in is Tom Tango's Fan Scouting Report. In fact Tango doesn't want you using UZR or RF or even E in this stat, just what your eyes tell you. Just like almost any stat it only becomes more and more reliable with a large sample size, so go on over and vote.