Beyond the Box Score: An SB Nation Community

Navigation: Jump to content areas:


Pro Quality. Fan Perspective.
Login-facebook

tRA explained sans numbers

Cross-posted from LL/DRB

The traditional way of evaluating pitcher effectiveness is ERA. There are a number of glaring flaws with this statistic, the primary one being that you can describe it as follows. 'How many earned runs (unearned vs. earned determined by the subjective home scorekeeper) a team concedes per nine innings when a certain pitcher is on the mound.' If you can't spot a couple of major issues here, stop reading now.

The primary problem, of course, that ERA is much closer to a team run prevention metric than a pitching one. Even at the major league level, defensive ability varies considerably. An adjustment is made for errors, but that's in the hands of a scorekeeper, and you can't make an error if you don't get anywhere near the baseball*. This seems a rather unfair thing to penalize a pitcher for. You see the defense issue popping up all the time - the early 00s Mariners, for example, had one of the best outfields in the history of the game, and their pitchers got all the credit for it. When Mike Cameron was removed from the equation, their ERAs rather predictably collapsed.

A couple of tertiary problems follow:

  1. Different stadiums have different effects on pitchers and hitters. A pitcher in Arlington suffers immensely compared to a pitcher in Petco Park, even if they are roughly equivalent in talent.
  2. We shouldn't really care about the unearned vs. earned run distinction, because giving up an unearned run is no different to an earned one in terms of wins and losses.
  3. ERA tends to fluctuate wildly year to year, which implies that it is divorced from a pitcher's true abilities.

Essentially, we need to look at what a pitcher can actually control to evaluate how good he is at pitching. Seems obvious, right? How?

What we can measure about a pitcher which the defense has no control over:

  • Strikeouts swinging
  • Strikeouts looking
  • Walks
  • Hit by pitch
  • Ground balls
  • Line drives
  • Popups
  • Fly balls
  • Home runs

By only looking at these numbers, defence is more or less entirely eliminated. There are a few robbed home runs every year, but that's neither here nor there. What do we do next? We have to figure out how many runs and outs each of these are worth. This is a long, complicated process, and I'm not going to go into the details here. Suffice to say that every line drive, strikeout, etc over an entire year is examined to see how many runs/outs result, with the average taken after the all of these events have been calculated. And then you can figure out how many runs and outs a pitcher should have given up, without considering his defence, over the course of a year. Much like ERA, tRA is calculated by Runs/Outs*27. Parks are also adjusted for (when measuring the bulleted list above). It's actually a pretty simple concept, and unlike ERA is defence independent, park independent, and much more stable year-to-year (meaning that it's a closer measure of talent - regressing tRA gets you even closer).

There are problems with it, of course - some pitchers' ground balls are hit harder than others', etc, but these issues pale in comparison to the challenges with using ERA to evaluating pitching. Just because ERA is more traditional and fits into the old-school definition of baseball stats better doesn't mean it's right. tRA, as well as other advanced statistics, can be found on StatCorner.

*The Raul Ibanez school of defence.

4 recs  |  Comment 19 comments |

Story-email Email Printer Print

Comments

Display:

You can't in fanposts.

Unless you go to html mode and code it yourself. If you’re an author and can create front page stories, there’s a fantastic copy-paste auto-table feature from Excel.

Beyond the Boxscore // Calling BJ Upton lazy is lazy.

by Sky Kalkman on Nov 9, 2008 3:44 PM EST up reply actions  

Okay, now I understand this.

Thanks.

Clutch: A measurement of how much better or worse a player does in high leverage situations than he would have done in a context neutral environment. http://www.fangraphs.com/blogs/index.php/glossary/

by bdalebs on Nov 9, 2008 4:19 PM EST reply actions  

me too

I need more of these stat primers sans numbers. It helps when I can figure out the idea behind it before my brain has to try grasping the equations. My brain is no longer up for that kind of multi-tasking

* sarcasm might be involved in this comment

by mattyfrommo on Nov 23, 2008 10:21 PM EST up reply actions  

Groundballs

Looking at the list over at statcorner, most of the top guys keep the ball on the ground with extreme groundballers Webb and Lowe both in the top 3. I’m just beginning to delve in the realm of sabermetrics, and it seems to me that starting pitchers with the most value are those who consistently keep the ball on the ground. This is a trend I would never see looking at traditional ERA, love this metric.

BTW, first time poster, I love the site. Keep up the outstanding work.

by Paul5418 on Nov 9, 2008 6:25 PM EST reply actions  

Thanks, Paul.

Both for the nice words and jumping into the conversation.

In general, GBs and non-HR FBs are just as valuable. GBs are hits slightly more often and FBs are extra-base hits slightly more often, and those advantages pretty much cancel each other out (plus GBs become GIDPs sometimes, too). But since GBs obviously can’t be HRs, while FBs can, that’s why GBs are more advantageous overall.

Another thing you’ll see is HR/FB ration, or what percentage of FBs from a pitcher become HRs. This measure fluctuates a LOT year to year. It IS a pitcher skill, just not that big of one. It’s a key explanation for why pitchers can be lucky or unlucky in a given season, similar to BABIP. It’s common to hear the cliche, “pitchers control whether the ball is hit in the air or not, but the hitter determines whether a flyball is a homerun or not.”

Beyond the Boxscore // Calling BJ Upton lazy is lazy.

by Sky Kalkman on Nov 9, 2008 6:50 PM EST up reply actions  

I second that.

It’s nice to hear from you, Paul, and we certainly hope that you comment in other threads if you feel inclined!

I’ll second what Sky said as well, since he, as always, explained it quite well. The only thing I’ll add is that ground balls can become double plays, which is not insignificant. Think about it: a pitcher who gets grounders on 3 out of every 5 balls in play has excellent odds of inducing a twin-killing with a runner on first.

by Peter Bendix on Nov 10, 2008 10:10 AM EST up reply actions  

when wouldn't it be a good idea to use the average run value for the defense-independent events?

which is also asking: are there certain pitchers for whom the average run value wouldn’t be a good idea?

nothing gets ‘em wetter than infrequent postings on the city’s second favorite team

by colintj on Nov 10, 2008 12:04 AM EST reply actions  

I think...

That this is the all-important question. Are there guys who can keep fly balls from becoming homers more often? Or who are able to induce ground balls in important situations, but whose overall GB rates might be lower than others?

I think that we have to keep questions like this in mind, but also keep in mind that nature of random fluctuation in statistics. It’s often difficult to sort the two out, and that’s where other information can often be of use.

The general answer, I think, is that for most major league pitchers, valuing defense-independent events is the best way to assess their ability.

by Peter Bendix on Nov 10, 2008 10:12 AM EST up reply actions  

"Are there guys who can keep fly balls from becoming homers more often?"

tRA separates home runs out from LD and FB, just so you know. tRA* regresses HR/ball in air more or less back to average (yty correlation from my study was something like 0.16)

by Graham on Nov 10, 2008 10:48 AM EST up reply actions  

What do you mean?

That tRA separates home runs out from LD and FB?

by Peter Bendix on Nov 10, 2008 11:29 AM EST up reply actions  

If doesn't assume that a certain percent of line drives or fly balls will end up as home runs

It just counts nonHR line drives, nonHR fly balls, HR line drives, and HR fly balls.

by Graham on Nov 10, 2008 11:33 AM EST up reply actions  

Interesting.

So is this one of the main reasons why some pitchers have a fairly large discrepancy between tRA and tRA*?

by Peter Bendix on Nov 10, 2008 11:38 AM EST up reply actions  

Yes

I wanted tRA to reflect what actually happened rather than penalising pitchers for home runs they didn’t give up, but obviously when you’re wanting to look at true talent (i.e. tRA*) you have to regress HR/ball in air.

You can actually see what’s being regressed and by how much if you click on a pitcher’s tRA* value.

by Graham on Nov 10, 2008 11:43 AM EST up reply actions  

Thanks, Graham.

I love Stat Corner and appreciate your taking the time to further explain tRA and tRA*.

by Peter Bendix on Nov 10, 2008 11:59 AM EST up reply actions  

There are certain pitchers who this would be less applicable to, yes.

But that’s not the same as it being a bad idea – the difference isn’t going to be huge one way or another.

by Graham on Nov 10, 2008 12:51 PM EST up reply actions  

The simple answer is...

YES! But the problem becomes identifying those pitchers. Of course, the spread in talent on these issues is much less than most people think, so using average values is a pretty good approximation. Just like pitchers don’t all have the same skill on BABIP – it’s still useful to regress 100% because that’s a lot closer to reality than 0% or even 50%.

Beyond the Boxscore // Calling BJ Upton lazy is lazy.

by Sky Kalkman on Nov 10, 2008 2:41 PM EST up reply actions  

Comments For This Post Are Closed


User Tools

We use numbers and stuff.
Community Guidelines
Why be a member?
Start posting on Beyond the Box Score »

Join SB Nation and dive into communities focused on all your favorite teams.

Connect_with_facebook

FanPosts

Community blog posts and discussion.

Recent FanPosts

Small
FIP is a Garbage Statistic
Jeter_400_101709_small
Scarier opponent come October?
Ghanafan03_741584gm-a_small
Los Angeles Angels trade for Dan Haren
Pedoria1_small
Pointing Fingers: Rollie Fingers and WAR
Small
Rajai Davis versus Gabe Gross
Small
Year of the Pitcher
Sealab_murphy_small
Prospect Surplus Value
T-rex_small
Saberizing a Mac, revisited
Small
How do you use splits?
Sealab_murphy_small
My Wang Problem

+ New FanPost All FanPosts >

Sign up for the BtB Newsletter!

BtB on Facebook

BtB on Twitter

RSS Feed: @BtBScore

Sky: @BtB_Sky

Jeff: @jeffwzimmerman
Steve: @steve_sommer
Dan: @dturkenk
Harry: @harrypav
Jinaz: @jinazreds
Jack: @jh_moore
Tommy R: @trancel
Justin: @justinbopp
Satchel: @SatchelPrice
Adam: @baseballtwit
Larry: @wezen_ball
Peter: @CapitolAvenue
Paul: @TheDiaTribe
Daniel: @CamdenCrazies
Matt: @devil_fingers

SBNation.com Recent Stories

ST. LOUIS - MAY 18:  Ryan Ludwick #47 of the St. Louis Cardinals rounds third base after hitting a game-winning homerun against the Washington Nationals at Busch Stadium on May 18, 2010 in St. Louis, Missouri.  The Cardinals beat the Nationals 3-2.  (Photo by Dilip Vishwanat/Getty Images) +3 updates

Padres, Cardinals, Indians Complete Three-Way Trade Involving Ryan Ludwick, Jake Westbrook

SEATTLE - JULY 08:  Alex Rodriguez #13 of the New York Yankees hits an RBI single in the ninth inning to give the Yankees a 3-1 lead against the Seattle Mariners at Safeco Field on July 8 2010 in Seattle Washington. (Photo by Otto Greule Jr/Getty Images) +16 updates

Yankees' 9th-Inning Win Completely Overshadowed By A-Rod's Ongoing Homer Drought

Colorado Rockies' Carlos Gonzalez is congratulated by teammates after his walk-off home run against the Chicago Cubs in the ninth inning of a baseball game at Coors Field in Denver, Colo. on Saturday, July 31, 2010.  (AP Photo/ Matt McClain)

Carlos Gonzalez Completes Cycle With Walk-Off Homer; Rockies Beat Cubs, 6-5

More from SBNation.com >


Managers

Limes_125_small Sky Kalkman

Wbc_029_small Jeff Sullivan

Editors

Rawlings_baseball_bigger_small Dan Turkenkopf

Dayton_small Jeff Zimmerman (TucsonRoyal)

Aviles_small Justin Bopp

Paige_small Satchel Price

Authors

Jinaz-reds-avatar_small JinAZ

Face_small Harry Pavlidis

Newavatar_small Matt Klaassen

Wezenball-logo_small lar

Big_pun--300x300_small Tommy Rancel

Adam_small adarowski

Redcap_small SFiercex4

St_louis_cardinals_ce1141_003263_small stevesommer05

Small garik16

Julio_teheran_2_small PWHjort

Cclogo_small Daniel Moroz

Closeup4_small J-Doug

Nick_cage_small The DiaTriber