tRA explained sans numbers
Cross-posted from LL/DRB
The traditional way of evaluating pitcher effectiveness is ERA. There are a number of glaring flaws with this statistic, the primary one being that you can describe it as follows. 'How many earned runs (unearned vs. earned determined by the subjective home scorekeeper) a team concedes per nine innings when a certain pitcher is on the mound.' If you can't spot a couple of major issues here, stop reading now.
The primary problem, of course, that ERA is much closer to a team run prevention metric than a pitching one. Even at the major league level, defensive ability varies considerably. An adjustment is made for errors, but that's in the hands of a scorekeeper, and you can't make an error if you don't get anywhere near the baseball*. This seems a rather unfair thing to penalize a pitcher for. You see the defense issue popping up all the time - the early 00s Mariners, for example, had one of the best outfields in the history of the game, and their pitchers got all the credit for it. When Mike Cameron was removed from the equation, their ERAs rather predictably collapsed.
A couple of tertiary problems follow:
- Different stadiums have different effects on pitchers and hitters. A pitcher in Arlington suffers immensely compared to a pitcher in Petco Park, even if they are roughly equivalent in talent.
- We shouldn't really care about the unearned vs. earned run distinction, because giving up an unearned run is no different to an earned one in terms of wins and losses.
- ERA tends to fluctuate wildly year to year, which implies that it is divorced from a pitcher's true abilities.
Essentially, we need to look at what a pitcher can actually control to evaluate how good he is at pitching. Seems obvious, right? How?
What we can measure about a pitcher which the defense has no control over:
- Strikeouts swinging
- Strikeouts looking
- Walks
- Hit by pitch
- Ground balls
- Line drives
- Popups
- Fly balls
- Home runs
By only looking at these numbers, defence is more or less entirely eliminated. There are a few robbed home runs every year, but that's neither here nor there. What do we do next? We have to figure out how many runs and outs each of these are worth. This is a long, complicated process, and I'm not going to go into the details here. Suffice to say that every line drive, strikeout, etc over an entire year is examined to see how many runs/outs result, with the average taken after the all of these events have been calculated. And then you can figure out how many runs and outs a pitcher should have given up, without considering his defence, over the course of a year. Much like ERA, tRA is calculated by Runs/Outs*27. Parks are also adjusted for (when measuring the bulleted list above). It's actually a pretty simple concept, and unlike ERA is defence independent, park independent, and much more stable year-to-year (meaning that it's a closer measure of talent - regressing tRA gets you even closer).
There are problems with it, of course - some pitchers' ground balls are hit harder than others', etc, but these issues pale in comparison to the challenges with using ERA to evaluating pitching. Just because ERA is more traditional and fits into the old-school definition of baseball stats better doesn't mean it's right. tRA, as well as other advanced statistics, can be found on StatCorner.
*The Raul Ibanez school of defence.
4 recs |
19 comments
|
Comments
You can't in fanposts.
Unless you go to html mode and code it yourself. If you’re an author and can create front page stories, there’s a fantastic copy-paste auto-table feature from Excel.
Beyond the Boxscore // Calling BJ Upton lazy is lazy.
Okay, now I understand this.
Thanks.
Clutch: A measurement of how much better or worse a player does in high leverage situations than he would have done in a context neutral environment. http://www.fangraphs.com/blogs/index.php/glossary/
me too
I need more of these stat primers sans numbers. It helps when I can figure out the idea behind it before my brain has to try grasping the equations. My brain is no longer up for that kind of multi-tasking
* sarcasm might be involved in this comment
by mattyfrommo on Nov 23, 2008 10:21 PM EST up reply actions
Groundballs
Looking at the list over at statcorner, most of the top guys keep the ball on the ground with extreme groundballers Webb and Lowe both in the top 3. I’m just beginning to delve in the realm of sabermetrics, and it seems to me that starting pitchers with the most value are those who consistently keep the ball on the ground. This is a trend I would never see looking at traditional ERA, love this metric.
BTW, first time poster, I love the site. Keep up the outstanding work.
Thanks, Paul.
Both for the nice words and jumping into the conversation.
In general, GBs and non-HR FBs are just as valuable. GBs are hits slightly more often and FBs are extra-base hits slightly more often, and those advantages pretty much cancel each other out (plus GBs become GIDPs sometimes, too). But since GBs obviously can’t be HRs, while FBs can, that’s why GBs are more advantageous overall.
Another thing you’ll see is HR/FB ration, or what percentage of FBs from a pitcher become HRs. This measure fluctuates a LOT year to year. It IS a pitcher skill, just not that big of one. It’s a key explanation for why pitchers can be lucky or unlucky in a given season, similar to BABIP. It’s common to hear the cliche, “pitchers control whether the ball is hit in the air or not, but the hitter determines whether a flyball is a homerun or not.”
Beyond the Boxscore // Calling BJ Upton lazy is lazy.
I second that.
It’s nice to hear from you, Paul, and we certainly hope that you comment in other threads if you feel inclined!
I’ll second what Sky said as well, since he, as always, explained it quite well. The only thing I’ll add is that ground balls can become double plays, which is not insignificant. Think about it: a pitcher who gets grounders on 3 out of every 5 balls in play has excellent odds of inducing a twin-killing with a runner on first.
by Peter Bendix on Nov 10, 2008 10:10 AM EST up reply actions
when wouldn't it be a good idea to use the average run value for the defense-independent events?
which is also asking: are there certain pitchers for whom the average run value wouldn’t be a good idea?
nothing gets ‘em wetter than infrequent postings on the city’s second favorite team
I think...
That this is the all-important question. Are there guys who can keep fly balls from becoming homers more often? Or who are able to induce ground balls in important situations, but whose overall GB rates might be lower than others?
I think that we have to keep questions like this in mind, but also keep in mind that nature of random fluctuation in statistics. It’s often difficult to sort the two out, and that’s where other information can often be of use.
The general answer, I think, is that for most major league pitchers, valuing defense-independent events is the best way to assess their ability.
by Peter Bendix on Nov 10, 2008 10:12 AM EST up reply actions
"Are there guys who can keep fly balls from becoming homers more often?"
tRA separates home runs out from LD and FB, just so you know. tRA* regresses HR/ball in air more or less back to average (yty correlation from my study was something like 0.16)
What do you mean?
That tRA separates home runs out from LD and FB?
by Peter Bendix on Nov 10, 2008 11:29 AM EST up reply actions
If doesn't assume that a certain percent of line drives or fly balls will end up as home runs
It just counts nonHR line drives, nonHR fly balls, HR line drives, and HR fly balls.
Interesting.
So is this one of the main reasons why some pitchers have a fairly large discrepancy between tRA and tRA*?
by Peter Bendix on Nov 10, 2008 11:38 AM EST up reply actions
Yes
I wanted tRA to reflect what actually happened rather than penalising pitchers for home runs they didn’t give up, but obviously when you’re wanting to look at true talent (i.e. tRA*) you have to regress HR/ball in air.
You can actually see what’s being regressed and by how much if you click on a pitcher’s tRA* value.
Thanks, Graham.
I love Stat Corner and appreciate your taking the time to further explain tRA and tRA*.
by Peter Bendix on Nov 10, 2008 11:59 AM EST up reply actions
There are certain pitchers who this would be less applicable to, yes.
But that’s not the same as it being a bad idea – the difference isn’t going to be huge one way or another.
The simple answer is...
YES! But the problem becomes identifying those pitchers. Of course, the spread in talent on these issues is much less than most people think, so using average values is a pretty good approximation. Just like pitchers don’t all have the same skill on BABIP – it’s still useful to regress 100% because that’s a lot closer to reality than 0% or even 50%.
Beyond the Boxscore // Calling BJ Upton lazy is lazy.

by 

























