Beyond the Box Score: An SB Nation Community

Navigation: Jump to content areas:


Sports blogs for fans, by fans.
Around SBN: Cal RB Jahvid Best Seriously Injured, Carted Off Field

Saber-Friendly Blogging 101: Making Sense of Defense

Continuing with Sky's Saber-Friendly Blogging 101 Series, this installment will focus on an issue of baseball sabermetrics that is likely gaining popularity not only on the internet but major league front offices as well; at least by judging the contracts handed out to players like Pat Burrell and Jason Giambi this offseason. I'm talking of course about defense.

I guess I should make a bit of an introduction first. My name is Graham Goldbeck, and I run the blog Oaktown Awesomer's. My contributions to BtB thus far have pretty much just been Oakland A's MS Paint drawings. But my true role besides the occasional story is sort of a quasi Fanshot director. So if any of you out there have an interesting blog which I can read and post links to when I find interesting articles/pictures, go ahead and post a link below or shoot me an email with a link, my email is at the bottom of the site.

But back to defense, and how it has been quantified over the years. For a long time, probably all the way back to Henry Chadwick's invention of the box score, the statistic which players' defense was measured by was the big E, or errors. Many a contract and/or Gold Glove was handed out based on the fact that (insert random player) committed the fewest errors or had the highest Fielding Percentage, so he must be an awesome fielder. But is this really true?

 

 

Star-divide

No. Well, there probably is some correlation between a player's number of errors committed and his fielding ability, but it is no where near as strong as it has been made out to be over the years. Just a quick anecdotal problem can show why this is false.

Say you have two 2B, one with exceptional range who makes the occasional poor throw to first base. Then you have another 2B with awful range but who makes perfect throws to first base everytime. 100 balls are hit in in the exact same way to both fielders in 300 innings. The first fielder fields 88 of them but makes 5 errant throws. The second fielder fields 58 of them but throws them all to first cleanly. Which 2B would you rather have? I would hope everyone said the first, as he's the much better fielder. This is just one reason why errors are very problematic in evaluating defense, and I haven't even addressed things like Official Scorer Bias (when is an error an error?), or that all errors are certainly not equal.

The situation I posted above is another defensive statistic that has been around for a while, Range Factor. Created by Bill James, it's simply Assists + Putouts / Innings Played. While its an improvement over errors, it too has glaring problems, like favoring infielders on teams with groundball heavy pitching staffs (they'd have many more opportunities for fielding plays) or players on teams with very low strikeout pitchers (more balls put into play).

Another stat which can be useful in evaluating team defense is the Defensive Efficiency Rating (DER). This is how many balls that are put into play are turned into outs. The quick and easy was to do this is 1- Team BABIP, but the full formula is:

1 - ((H + ROE - HR) / (PA - BB - SO - HBP - HR)).

It is helpful in measuring team defense, but again falls short, in this case by favoring teams with flyball heavy pitching staffs (less likely for a flyball to go for a hit unless its a HR, which is subtracted from the equation) and assuming all balls hit into play are equally likely to be fielded.

But the search for defensive evaluation has kept evolving, and has manifested itself most recently -especially with the aid of play by play data- in zone based defensive ratings. In a zone rating metric, there are general areas in the field of play a given fielder is "responsible" for fielding balls in.

Zrgrid_medium

via www.baseballthinkfactory.org

This is the STATS Inc. Zone Rating Grid, which the Zone Rating (ZR) defensive statistic is based off. I mention STATs Inc. because their baseball charting data is different than that of Baseball Info Solutions (BIS), the other large baseball data provider. More stats are based off the BIS data, including John Dewan's Plus/Minus (subscription to Bill James Online needed), David Pinto's Probabilistic Model of Range (PMR) and Michael Lichtman's Ultimate Zone Rating (UZR).

Each of these systems has their own pluses and minuses (haha!), and I won't get into a large debate about them here. The important thing they all do that ZR does not is adjust for balls in a given zone that are not considered fieldable (whether it by by location, speed, trajectory, etc). How they do that I believe varies by system.

These systems have their own shortcomings too, they don't address an outfielder's arm strength or infielders ability to turn a DP. But they are currently (as far as I know) the best defensive stats publicly available.

Ideas for a team specific article:

  • Explain why your team's error total may not be a good indicator of team defensive prowess. Maybe do the same for some of your team's players.
  • Post various defensive statistics for players on your team in a chart and compare how the different statistics evaluate each player (any huge discrepancies like Andruw Jones?)
  • Take a crack at explaining what defensive shortcomings your team or a specific player on it might have and how they can overcome it (if possible). This suggestion is a little less sabermetric-y, but you can still use things like balls fielded above/below average in your analysis.
  • See if there are any Free Agents out there who may improve your team who may be "undervalued" because of their defense.

To get things rolling a bit for discussion, here's a chart of a bunch of various defensive statistics teams compiled in 2008.

Note: This chart is sorted by UZR/150, and fielding +/- is in plays.

 

Team E FP DP Def Eff. Fldng +/- PMR RAA/4000 UZR/150
Rays 90 0.985 429 0.708 24 30.9 9.5
Phillies 90 0.985 380 0.695 52 -14.2 6.7
Red Sox 85 0.986 399 0.698 7 28 6.1
Athletics 98 0.984 467 0.699 20 28 4.3
Astros 67 0.989 379 0.697 26 24.3 4.1
Cardinals 85 0.986 430 0.694 58 13.5 3.8
Nationals 123 0.98 387 0.686 5 -23.2 3.9
Brewers 101 0.984 425 0.7 59 22.7 2.9
Giants 96 0.984 341 0.685 -32 -8.9 3
Royals 96 0.984 431 0.688 -33 -39 2.5
Blue Jays 84 0.986 366 0.703 72 51.3 2.6
Mets 83 0.986 344 0.699 25 -15.1 2
Cubs 99 0.983 311 0.703 28 8.8 1.4
Indians 94 0.985 498 0.685 -1 1.7 0.8
Marlins 117 0.98 328 0.692 2 -1.3 0.1
Angels 91 0.985 441 0.691 -5 23.8 -0.1
Braves 107 0.983 404 0.692 29 38.9 -0.1
Orioles 100 0.983 441 0.687 -27 -24.3 -0.3
Padres 85 0.986 401 0.694 16 -19.3 -1.9
Pirates 107 0.983 504 0.694 -32 -21.8 -2.3
White Sox 108 0.983 427 0.686 5 -0.8 -2.4
Twins 108 0.983 465 0.684 -11 5.8 -3.2
Diamondbacks 113 0.981 374 0.685 -27 -2.9 -3.5
Mariners 99 0.984 430 0.679 -46 4.5 -4.2
Dodgers 101 0.984 376 0.69 8 10.8 -4.9
Rangers 132 0.979 528 0.666 -61 -17.6 -4.5
Tigers 113 0.981 466 0.683 -54 -11.4 -4.9
Yankees 83 0.986 366 0.682 -30 -26.5 -5.2
Reds 114 0.981 414 0.671 -53 -34.6 -5.8
Rockies 96 0.985 466 0.677 -21 -22.5 -9.1

 

One last thing:

If all this defensive info still sounds like mumbo-jumbo, one stat which everyone can get involved in is Tom Tango's Fan Scouting Report. In fact Tango doesn't want you using UZR or RF or even E in this stat, just what your eyes tell you. Just like almost any stat it only becomes more and more reliable with a large sample size, so go on over and vote.

 

0 recs  |  Comment 2 comments

Story-email Email Printer Print

More from Beyond the Box Score

Graph of the Day: Range Factor

Aug 2009 by Jack Moore - 13 comments

Comments

Display:

I have some questions

These are related to the methodology of advanced fielding metrics like Plus/Minus, PMR, RZR and UZR.

1. I’m trying to determine how much an infielder’s throws are taken into account. Let’s say that a SS gets to a groundball, fields it cleanly and then makes a strong, but inaccurate throw, pulling the first baseman off the bag and no out is recorded. It is my general understanding that Dewan’s Plus/Minus takes into account where the ball was hit and how often such balls were turned into outs. Therefore, whether the player actually turned it into an out takes into account everything: range, glove, arm strength, and throw accuracy. Now, it doesn’t differentiate between them, but it does include the whole package. It is also my general understanding that the other advanced fielding metrics don’t do this. They count whether the fielder effectively fielded the ball, but not whether the out was made. Is this true?

2. In measuring a first baseman’s defense, does any fielding metric account for a first baseman’s ability to receive thrown balls? I’m referring to a first baseman’s ability to pick bad throws, stretch, knowing when to come off the bag to prevent an errant throw and that sort of thing. It is my understanding that advanced fielding metrics only take into account a first baseman’s fielding of the ball and, in the case of Dewan’s Plus/Minus, his throws.

The immoderate moderator

by NYRoyal on Jan 16, 2009 11:36 AM EST reply actions   0 recs

1. I believe all the advanced systems handle it the way you described for +/-.

They measure fielding as “out conversion”. Outfield throwing arms are a different beast, and are included as separate pieces. Well, if it’s included, since I don’t think PMR looks at that.

2. Right, except for maybe +/-, first base catching ability is ignored. Sean Smith has taken a historical look at that, though. Pizza Cutter’s OPA! system might also tackle it.

Beyond the Boxscore // Calling BJ Upton lazy is lazy.

by Sky Kalkman on Jan 16, 2009 5:37 PM EST up reply actions   0 recs

Comments For This Post Are Closed


User Tools

We use numbers and stuff.
Community Guidelines
Why be a member?
Start posting on Beyond the Box Score »

Join SB Nation and dive into communities focused on all your favorite teams.

FanPosts

Community blog posts and discussion.

Recommended FanPosts

Small
PZR-based Win Values 2001-2006

Recent FanPosts

Small
The "30 parks on a budget" challenge
Sunflower_small
World Series Simulation, Game #6
Small
JT20 Dynasty League
E52205a2_small
New Look
Sth70021_small
Exploring Hit f/x, Albeit Badly
Redcap_small
Ricky Nolasco: 4 WAR or 1 WAR?
Redcap_small
Apparently I can't do park adjustments
Small
Which tells us more: The last 7 at bats or 7 at bats against this pitcher?
Sleepy_jeff_small
How Efficient and Effective Were the Rockies in 2009?

+ New FanPost All FanPosts >

FanShots

Quick hits of video, photos, quotes, chats, links and lists that you find around the web.

Recent FanShots

The Mistake Lottery
On the Field, the Yankees Are The Team of the Decade. Off It? The Red Sox.
Tigers' all-time WAR leaders
Primer on Runs Created
How to improve basketball
LB Keith Bulluck uses a sabermetric analogy to explain the Titans' quarterback situation.
Alcides Escobar "abandoned his daughter before she was born"
UZR, Scouting, and the Fans
Not-So-Lousy Lineup Optimizer, Playoff Edition: New York Yankees

+ New FanShot All FanShots >

BtB on Twitter

Main Feed: @BtBScore

Tommy B: @tommy_bennett
Sky: @BtB_Sky
Dan: @dturkenk
Harry: @harrypav
Jinaz: @jinazreds
Jack: @jh_moore
Erik: @Erik_Manning
Tommy R: @trancel
Justin: @justinbopp

Subscribe to BtB via Email

Enter your email address:

Delivered by FeedBurner

Most Commented

Limes_125_small
Time To Move On
Nando_small
A Complete and Lenghty List of Baseball-Related Things Miguel Olivo is Good At
Aviles_small
Minnesota: Fielding TargetView Before & After JJ Hardy
770insig_small
Negative Team WAR - 2009 Edition
E52205a2_small
New Look

BtB Goes Social


Managers

Nando_small R.J. Anderson

Limes_125_small Sky Kalkman

E52205a2_small Tommy Bennett

Editors

Face_small Harry Pavlidis

Rawlings_baseball_bigger_small Dan Turkenkopf

770insig_small Jeff Zimmerman (TucsonRoyal)

Aviles_small Justin Bopp

Authors

Banny_small erik

Raysring1_small Tommy Rancel

Jinaz-reds-avatar_small JinAZ

Jmlogo_small Jack Moore

1753738656_110919ebe9_o_small vivaelpujols

1_small Graham

Baseball_small Mike Rogers

Redcap_small SFiercex4

Small Patrick Clark

Walter_album_small Walter Fulbright