Daily Box Score 8/10: Replacement Levelheaded
If you've ever taken a class in economics, one of the first things you learned about was the difference between accounting costs and economic costs. Accounting costs are the nominal price of object--you can think of this as the sticker price. Economic costs are also known as opportunity costs, and I'll leave it to Harvard economist Greg Mankiw to define the term:
The opportunity cost of an item is what you give up to get that item.
And that must include the value of all the other options that are now precluded. The concept of opportunity cost is at the heart of the sabermetric concept of "replacement level." As important as the concept is, are there aspects of it that need refining? Today's box score looks at the concept of replacement level, as well as the related concepts of average players and player peaks.
Table of Contents
The Waiver Wire
The Shallow End of the Talent Pool
Whence the Talent Comes
The All-Average Team and Player Peaks
Discussion Question of the Day
A replacement level player is defined to be the level of freely available talent at a given position. Whether that talent is acquired via the Rule 5 draft, waivers, free agency, or the minor leagues, it is typically the sort of player who bounces back and forth between Triple-A and the major leagues. Because they are freely available, the reasoning goes, no team should do worse than replacement at any position. Conversely, all players ought to be judged by their contributions above and beyond replacement level. That is to say, the replacement level player represents the opportunity cost of acquiring any other player. In equation form, it looks like this
Benefit - Cost = Surplus
And renaming the terms gives (roughly speaking):
Total production - Replacement level = WAR
But many people (including some smart ones) argue that replacement level misses a crucial aspect of the market for baseball talent: the fact that ballplayers are not perfectly fungible. Here's Christina Kahrl, writing about Alex Rios:
Players aren't freely available in the way that, say, sofas are; one start-worthy sofa's value over a replacement-level sofa can be easily resolved by just going out and buying that quality sofa. (And no, you do not have to wait for Ikea to put it on waivers.) Unlike sofas, there is not a limitless supply of ballplayers, and they're not all freely available at the same time. If, between the trickle of off-season free agents at the position where you have a specific need, your own farm system, and the mish-mash of journeymen sloshing around the minor league free agency pool, there's nothing and nobody that grabs you when it comes to filling that specific need, you might understandably go after the best player at the position available at any price to try and help yourself, and hang the expense.
Put slightly differently by Mike Silva:
Who is the typical average minor leaguer? Anderson Hernandez? Nelson Figueroa? Sergio Mitre? Josh Towers? Fernando Martinez? Shelley Duncan? Do you Get the point?
(Just for fun, their 2009 WARs are 0.2, -0.1, 0.2, n/a, -0.5, n/a, respectively, which suggests to me that perhaps he understands the concept better than he is letting on).
In any event, this is an important criticism. Teams to do not seek upgrades over a theoretical replacement level but rather over whatever it is that they've already got. So, in context, each team has an individual replacement level that represents its opportunity cost for any given transaction.
If we are looking at the value of, say, Alex Rios, we ought to compare his expected production to the expected production of the in-house options, and value the difference in wins at $4.5 million (or whatever the correct number is) per win. Of course, as the time horizon lengthens from a few months to several years, the market for talent does in fact become more fungible and the granularity of the world approaches the efficiency of the model.
(Besides, no market is perfect--I speak from experience in saying that while you don't have to wait for Ikea to put a sofa on waivers, you do have to wait until you've given yourself a few gashes before the thing is completely assembled.)
The Shallow End of the Talent Pool
It is the very nature of replacement level that it depends on the pool of freely available talent. Therefore, it is sensitive to changes in the makeup and quality of the available talent. Recently, Kevin Goldstein has suggested that there is currently a drought in the availability of talent on the left side of the infield (particularly shortstops):
The reasons for the decline are numerous. The loss of athletes to sports like basketball, football, and soccer continues to be an issue, and there's also now a mindset for many teams that tells them that up-the-middle players are better sourced from the international market, specifically Latin America. However, one scouting director noted that there's more of a lack of focus on the position itself when in comes to player development for young players in North America. "Part of the problem is that the kinds of players that play shortstop in college and high school aren't the kind of players that we see as playing there in the big leagues," one scouting director explained. "Often it's not the best athlete as much it's it's the steadiest fielder playing there; we see that all the time, even in college, so often what teams are doing doesn't match what we're looking for."
According to his data, in the period 1965 to 1969, an average of 16.1 shortstops were drafted in the first 100 picks. By the period 2000 to 2009, the number was 10.6. Given that replacement level is a fluid concept, we can infer that the value of shortstops has likely increased as the number drafted has decreased. Of course, this is not surprising--given a fixed demand and a limited supply, the value of a good tends to rise.
However, what is surprising is not that the value of shortstops has risen, but rather that there has not been a related increase in the supply of shortstops. If the price that can be fetched by a shortstop has gone up as teams are willing to pay more, we would expect more high school/amateur baseball players to work hard so they might be able to stick at shortstop. And yet Goldstein's data suggest this has not been happening.
I have made no secret of my dislike of the current draft structure. That's why my attention was piqued when I saw this post by the Kansas City Star's Sam Mellinger:
Baseball’s CBA is scheduled to end after the 2011 season. Many baseball insiders on both sides of the negotiation say the players are willing to institute some sort of slotting system for draft picks, but need to get something back from owners in return.
He argues that any changes will be the direct result of the strength of the MLBPA, and the MLBPA is the most successful labor union in the history of the United States. Craig Calcaterra thinks this could result in hard-slotting:
It won't take much in return, I'd wager. Most people don't realize this, but draftees aren't union members -- you don't become eligible to join the union until you're on a 40-man roster -- yet the members have the power to negotiate the terms of the draft. As such, giving the owners a hard slotting system doesn't truly take anything off the union's plate.
It is difficult to say what consequences this might have on the quality of the talent pool. On the one hand, lowered upfront compensation might deter some players from choosing to play baseball (perhaps choosing football or basketball instead). On the other hand, hard-slotting might rationalize the talent market, ensuring dollars went to players who actually contributed wins a major league level, which in turn might guarantee greater fungibility.
The All-Average Team and Player Peaks
One compounding issue in assessing the quality of the talent pool as a whole is the related concept of a league average player. The easiest way for sabermetricians to calculate replacement level is in reference to the average production at each position. How do we know what average production looks like? Why, we ask wezen-ball.com, of course!
I broke every player into their primary position (ie, the position that they played the most that season) and found the average across each position.
I won't spoil the surprise too much by listing the whole team, but I can't resist sharing with you that the most average season EVER by a second baseman was turned in by Tony Bernazard, in 1985. Honestly, I might be afraid to challenge him for that honor.
One thing to keep in mind is that average production is very valuable. By definition, average value must be at least equal to replacement level. That means sustained but average production is worth keeping around. But not all players contribute this way--some burn fast and bright. The difference, writes Lincoln Mitchell, is the difference between Eddie Murray and Willie McCovey:
The practical question this raises is which is more valuable. The question, while somewhat abstract, because career paths cannot be predicted with great certainty, is still important when thinking about building teams, particularly when making decisions about free agents.
If it were possible to predict which types of players would have more stable peaks, I think all other things being equal, teams would be wise to choose the most stable. That way, they are better able to gauge how much talent they need to be a playoff-bound team.
Discussion Question of the Day
For a little fun, I'd like to point your attention to this North County Times article about one of the greatest fights baseball has ever seen. It includes a Tony Gwynn bodyslam and a DL player suiting up just to participate.
For discussion, though, I'd like to get your opinions about replacement level. It is certainly a useful concept, and provides a common baseline for analysis. However, it also clearly has limitations. So, then, when is the concept of replacement level most useful? Least useful?
What do you think?
0 recs |
23 comments
|
Comments
Replacement Level & the "Trade Value Calculator"
I am happy to see this line of reasoning being explored here. Your distinction between accounting costs and economic costs is an important one…one that I feel is often overlooked on this website.
Last week, Jack Moore wrote a post in which he claimed the Blue Jays would be making a “huge mistake” in letting go of Rios for nothing. His argument is based upon the finding of Sky’s “Trade Value Calculator” that Rios is worth $11.4M over a replacement player, even in spite of his huge contract.
Well, there is a serious problem with this logic—and with the Trade Value Calculator more broadly. Mr. Moore fails to account for exactly WHO Alex Rios’ replacement is. In this case it is not a true replacement player but Travis Snider, who projects as a future star and is hitting .320/.417/.653 in the INT league as a 21 year old. Surely the Blue Jays would be better served to replace Rios with Snider and spend $12M/yr addressing areas of greater need.
I think the Trade Value Calculator should be revised to account for Mr. Bennett’s important distinction between accounting and economic costs. It should look more closely at case-specific context.
by fletchdm on Aug 10, 2009 6:48 PM EDT reply actions 0 recs
Let's keep in mind
It may very well be the case that the best option for Toronto is to rid itself of Rios’ contract and play Snider in the outfield. At the same time, other teams likely value Rios more than his contract will cost them. That means a couple things, from a game theoretic standpoint:
1. It was very likely a trade would happen
2. All we can say, a priori, about a potential trade is that the other team will have to give up somewhere between a portion of Rios’ owed salary on one end and the full salary plus prospects equivalent to that teams own estimation of Rios’ surplus value.
3. Between these two goalposts, the actual price will be determined by a number of factors, one of which is the shrewdness of the GMs. However, keep in mind that teams may reject trades that are in their best interest if they think they are being cheated (as I believe was the case with Ricciardi and Halladay).
I’m working on something to flesh this out in more detail, but it’s important to keep in mind that it may be simultaneously true that the Blue Jays did the right thing by trading Rios AND that they did not get as much in return as they might have under other circumstances.
by Tommy Bennett on Aug 10, 2009 7:50 PM EDT up reply actions 0 recs
I agree.
it may be simultaneously true that the Blue Jays did the right thing by trading Rios AND that they did not get as much in return as they might have under other circumstances.
As an extreme example, if you have two priceless paintings to hang, but only one spot and it costs you $10/year to store the other one, should you give it away so you don’t have to pay the storage cost?
Beyond the Boxscore Not a member? Sign up.
by Sky Kalkman on Aug 10, 2009 7:56 PM EDT up reply actions 0 recs
There's also 1B or a better trade.
Beyond the Boxscore Not a member? Sign up.
by Sky Kalkman on Aug 10, 2009 7:57 PM EDT up reply actions 0 recs
Re: 1B or a better trade
Snider as 1B: I would take Snider+Overbay+12 million over Rios+Overbay any day. There’s also Brian Dopirak in Las Vegas who is absolutely mashing and is an immediate upgrade over Lyle Overbay. I can’t fathom why I haven’t heard Dopirak’s name mentioned yet on any “prospect buzz” blogs.
Better trade: This encompasses my response to Tommy’s “Let’s keep in mind” posting too. If I were Kenny Williams, and I had exclusive bargaining rights with Toronto, why would I feel compelled to give Ricciardi anything in return when I was confident he would ultimately part with Rios for no return.
Sky, I see you have not reacted to my suggested improvement to your trade calculator. Would it not be a superior product if it accounted for case-specific context?
by fletchdm on Aug 10, 2009 8:34 PM EDT up reply actions 0 recs
Trade calculator
The question of course is how to do this in an automated fashion. The beauty of Sky’s calculator is how easy it is to use. The more variables you have to input, the less useful it is to have a trade calculator. That said, I think it is best used as one tool among a few.
by Tommy Bennett on Aug 10, 2009 8:39 PM EDT up reply actions 0 recs
Yeah, it's definitely not the end-all.
Start with it, then add in additional context.
Beyond the Boxscore Not a member? Sign up.
by Sky Kalkman on Aug 10, 2009 8:49 PM EDT up reply actions 0 recs
Automating the calculator
I don’t see why automating the trade value calculator to express case-specific context should be terribly difficult. In this case, the equation would be
Trade value for Ricciardi = (Snider netM – Rios netM) + (Value Of Return=0). If the equation’s value is positive, it’s a good trade.
As another example of how this could work, take the Sanchez-Alderson trade from Pittsburgh’s perspective:
Trade value for Huntington = (D. Young netM – F Sanchez netM) + Alderson netM.
Yes, this was a huge coup for Pittsburgh.
by fletchdm on Aug 10, 2009 9:27 PM EDT up reply actions 0 recs
Exactly, just run it four times.
Beyond the Boxscore Not a member? Sign up.
by Sky Kalkman on Aug 10, 2009 11:09 PM EDT up reply actions 0 recs
And I see the biggest improvement in the calculator as a playoff probability adjustment.
Need to model future seasons’ playoff probabilities, though.
Beyond the Boxscore Not a member? Sign up.
by Sky Kalkman on Aug 11, 2009 9:21 AM EDT up reply actions 0 recs
Yes, but Snider isn't a free asset.
The Jays have invested a significant amount into Snider, in terms of draft bonus, development, etc. (And you can’t look at just Snider’s draft bonus – you pay draft bonuses to a crop of players, many of whom will fail, in order to get just one prospect that pans out. This is why teams get a certain number of cost-controlled years for players.)
The Jays could put Snider in left, put him at DH, trade him for something – you don’t dump Rios just to give Snider a place to play.
The real issue here is that the trade value calculator has a certain dollar per win value that is likely based on historical trends; the Jays may anticipate that these trends won’t hold due to the economy, in which case Rios might be overvalued.
by cwyers on Aug 10, 2009 10:59 PM EDT up reply actions 0 recs
The Jays could put Snider in left, put him at DH, trade him for something – you don’t dump Rios just to give Snider a place to play.
I think this is absolutely right, although Adam Lind has been taking most of the PAs at DH this season, and doing a fine job. However, the first part of your comment has me a bit confused. While it may be true that the Jays had to invest a considerable amount in Snider, the fact that they did so in the past makes it a sunk cost, and therefore not relevant to current decisions, no? The marginal costs of playing Snider are very low (essentially league minimum for the next 2.5 years). What have I missed?
by Tommy Bennett on Aug 10, 2009 11:40 PM EDT up reply actions 0 recs
Because the right to pay Snider the league minimum has tremendous value.
It’s not a “sunk cost” because the Jays are getting a return on it – the pre-arb years of a player like Snyder are essentially like the intrest payment on a bond that’s matured.
That’s why you can’t declare that Rios’ value to the Jays is Rios – Snyder + Return, because you’re missing out on how much it would cost the Jays to go out and get another Snyder. It’s like saying you can give away a car for free because you have two cars and you can only drive one at a time. This ignores the fact that you can sell one of the cars, or keep one of the cars in the minors and delay the start of its service time clock until its more valuable peak years. (Okay, that’s where the car analogy breaks down a bit.)
by cwyers on Aug 11, 2009 12:15 AM EDT up reply actions 0 recs
I think your point—that Rios’ value to the Jays =/= Rios – Snider + Return—is correct. But I think it is correct for a different reason than the one you cited.
I think it is related to chaining effects (especially since the Jays are an AL team). As you said, they have a few different options where they could play Snider. For example, Jose Bautista has played 70 games in the outfield this season. Let’s assume Snider is an upgrade over Bautista (using the wOBA approximation and in-season PECOTAs, he rates out at .340 vs. Bautista who has been a .323 player this year). It might have given the Jays an advantage to play Snider over Bautista even if they hadn’t traded Rios. Now that they have, they need someone in right field as well.
Your point that they could have left Snider in the minors until he’s closer to his peak is probably true, although with a .320/.417/.653 in ~175 Triple-A ABs, I’m not sure he has much left to prove.
by Tommy Bennett on Aug 11, 2009 11:13 AM EDT up reply actions 0 recs
Well said!
Often when it comes to statistical analysis things are looked at in such black-and-white detail, it can be off-putting. This is an excellent example of how to look at Replacement Level with the shades of gray it comes in.
It’s the same way organizations evaluate trades. Sometimes an organization is so deep at one position, they can afford to allow a prospect with solid projections get away because the assumption is that that player will step in and deliver something over replacement level himself. (Hence fletchdm’s comment about Travis Snider although Snider failed to inspire in his stint earlier this year.)
If the Mets were making a run and needed a RF due to injury there’s no guarantee that the player they replace the injured player is going to be even at replacement level. They should be able to evaluate their options and determine Rios’ value compared to those options. In some cases, he might be worth more to that team based on their replacement level options.
by bj316 on Aug 10, 2009 7:21 PM EDT reply actions 0 recs
If the Mets were making a run and needed a RF due to injury there’s no guarantee that the player they replace the injured player is going to be even at replacement level.
The fact that the Mets did need a RF and that they did get a guy who isn’t even at replacement level can be taken two ways – either as evidence of your point or evidence that the Mets have poorly evaluated talent. I lean towards the latter.
by cwyers on Aug 11, 2009 12:08 AM EDT up reply actions 0 recs
Tommy, I just wanted to mention that you're doing an excellent job with Daily Box Score
Most of the time, link dumps are lame, even though all blogs do it. This is one of the better ones, as it includes some great insight as well. In specific, this post was great.
On replacement level, I think it’s useful in determining the value of a player. It’s very lowest baseline that would be major league acceptable, and it represents something that is mostly realistic (Triple-A scrubs that cost teams little to no money). However, in trade evaluation, I agree that a team should look at how much value a player’s addition is adding to the team, and that takes into account his replacement. Luckily, we can prorate expectations for WAR from all players and compare them off of the same baseline. In this case, it’s similar to comparing them to nothing at all, as the baseline is the same on both sides, but you still get the benefit of analysis of real players replacing others.
by SFiercex4 on Aug 10, 2009 10:04 PM EDT reply actions 0 recs
However, what is surprising is not that the value of shortstops has risen, but rather that there has not been a related increase in the supply of shortstops. If the price that can be fetched by a shortstop has gone up as teams are willing to pay more, we would expect more high school/amateur baseball players to work hard so they might be able to stick at shortstop.
This makes sense from an economics perspective, but not really from a baseball perspective. High-school ball players don’t say “hmmm, shortstops make 20% more (or whatever) than second basemen with comparable offensive numbers.” They play where their skill set best fits, or, if they take any take influence from the majors, they play where a favorite player plays. I seriously doubt there are any players out there who are better at 3B or CF than SS who are running the numbers and deciding to take ground balls at short all day every day until they get drafted.
by rileydog22 on Aug 11, 2009 12:01 AM EDT reply actions 0 recs
I sort of agree
but the key is that since so many players who end up being third basemen and second basemen make their start at shortstop, you would think some of these players would attempt to stick at short and improve at the position since it is more lucrative for them to do so. It isn’t as if no one is playing short, but HS shortstops are always being converted in the minors.
by SFiercex4 on Aug 11, 2009 10:16 AM EDT up reply actions 0 recs
I hope you didn’t read this post as an exercise in denigrating the entire concept of replacement level. The title of your post suggests that you are both tired of explaining it and annoyed by the challenge, so I wanted to be clear that I wasn’t asking anyone to justify replacement level.
by Tommy Bennett on Aug 11, 2009 12:59 PM EDT up reply actions 0 recs
I'm OK with replacement level
as a general basis.
What I question is the linearity of the payscale estimation associated with WAR. Assuming a 2 WAR player to be worth twice that of a 1 WAR player, a 4 WAR player to be worth twice that again, and so on, assumes that they are all available in a similar proportion.
A quick glance at WAR for last year, for each infield position, the WAR distribution seems like a normal or slightly skewed curve. The limitation at the top would be the talent ceiling. The limitation at the bottom is a team’s willingness to put up with sub-standard (and by standard I’m referring to what the other teams are fielding) performance.
I see the availability of players to be less like shopping at Ikea and more like shopping on craigslist. When someone posts an Alex Rios, you figure someone might jump at it. When someone posts a Melvin Mora, you figure nobody wants it, and wait for the price to go down.
"I hate seeing Bedard go, but I think the O's may have gotten the better end of the deal" -- me, 2/8/08
by CoachOfEarl on Aug 11, 2009 1:05 PM EDT reply actions 0 recs
Great article
and I appreciate all the comments and analogies on here. I’ve been a baseball fan for years, but am a sabermetrics noob and still trying to wrap my brain around some of these concepts. Hopefully, I’ll soak up some of the vast knowledge floating around here the longer I hang out. Keep up the good discussions, everyone!
"Baseball has been good to me since I quit trying to play it." - Whitey Herzog
by Bring Back Tommy Herr! on Aug 11, 2009 4:46 PM EDT reply actions 0 recs

by 











BtB on Facebook















