Non-Linear Cost-Per-Win Analysis
A month ago I wrote the classic Cost Per Marginal Win post, comparing each team's payroll above league minimum (about $13MM) to their win total above replacement (about 48 wins). It's a nice approach, but actually only addresses a very specific question: "How much are teams spending per marginal win?" While interesting, we often want to answer questions about front office comptetency.
The main flaw in a straight cost-per-win analysis is that the first extra dollar spent on payroll is much more efficient than the 100-millionth extra dollar spent. Florida, for example, barely spent more than they had to. That money went to very small raises to good players in their first three years of team control (Dan Uggla made $27,000 more than the league minimum), first-year arbitration salaries (Alfredo Amazega made just under $1MM), and cheap, cost-efficient free agents (Jorge Cantu provided 2.8 WAR for $500K). Players in those categories earn anywhere from literally nothing per marginal win to, say, $500K per marginal win.
On the other hand, the New York Yankees, with their $209MM payroll, spent the majority of their money on free agents. Free agents are not good bargains, earning about $4.5MM per marginal win. And while there's a good argument to be made for the Yankees mismanaging their money, there's no way they can spend that much money on payroll and not spend a lot of it on free agents. There's only so much money to spend on cost-controlled and arbitration-eligible players. If you want to spend more, you have to sign free agents.
To summarize, most teams need to spend more in order to win more games, but the more you spend, the less efficient each dollar is. Starting at the cheapo end of the scale, here are some estimates of where extra money goes as more is spent, at what rate it's spent, and how good the team can expect to be:
- The London McScrooges, minimum payroll: Money is spent exclusively on players in their first three years of service, at the league-minimum rate of $390,000 with minimal raises, if any at all. Some replacement-level free agents might be signed. The cost per win isn't much above zero. Success isn't common, although the farm system should contain enough talent that this team is definitely better than replacement-level. 66 wins.
- 1997 Tampa Bay Rays, $25MM: Extra money is spent on first-year arbitration players at about $1.8MM per marginal win (40% of FA rates). Payroll isn't much more than with the Scrooges, but the extra money buys quite a few wins. 71 wins.
- 1998 Colorado Rockies, $55MM : Extra money is spent on second and third year arbitration players at $2.7MM to $3.6MM per marginal win (60% and 80% of FA rates). In addition, teams might buy out some free agent years at similar rates while buying out arbitration years (see the recent Evan Longoria and Dustin Pedroia contracts). These teams are still below league-average payroll, but have a non-zero shot at a playoff spot given a strong crop of young players. 76 wins.
- 2000s St. Louis Cardinals, $90MM: Extra money is spent on lower-level free agents who may come at a discount. Teams take what they can get to fill holes without spending the full price of $4.5MM per free agent marginal win. Big name free agents rarely fit the criteria. At this point, teams are spending about the league average and winning a league average number of games. 81 wins.
- New York Mets, $120MM. Extra money is spent on bigger name free agents. Holes are filled by Derek Lowe- and Adam Dunn-types instead of Jon Garland- and Garret Anderson-types. This spending isn't very efficient ($4.5MM per marginal win compared to the overall average of $2.7MM per marginal win) but going from 81 wins to 86 wins leads to a significant increase in playoff probability. 86 wins.
- Boston Red Sox to New York Yankees, $160M to $210MM. Extra money is spent on the best of the best. Because there are a limited number of players who will contribute on the field, it's worth overspending on star players. Obviously, there's a huge payroll gap between the Red Sox and Yankees. If the two teams were equally intelligent, you'd expect about 91 wins from a payroll the size of Boston's and 96 wins from New York's $200MM+ payroll. That the Sox have kept pace with the Yankees for the last five years is a testament to Theo Epstein and company.
So what we need now is a model of how the cost-per-win changes the more money a team spends. Thankfully, David Gassko and Tom Tango have done some work in this regard, and I'm going to borrow their result:
ExpWins = (P + 2*L) / (P + 5*L) * 162
P is team payroll and L is league-average payroll. The model is basically saying "Given a front office with average ability, how many wins would you expect out of a team that spends P on their payroll?" Here's the effective cost-per-win at various payroll levels given the model:
| Payroll $MM | ExpW | Cost Per Win |
| $13 | 67.5 | $0.0 |
| $20 | 69.0 | $0.3 |
| $30 | 70.9 | $0.7 |
| $40 | 72.8 | $1.1 |
| $50 | 74.6 | $1.4 |
| $60 | 76.3 | $1.7 |
| $70 | 77.9 | $1.9 |
| $80 | 79.5 | $2.1 |
| $90 | 81.1 | $2.3 |
| $100 | 82.6 | $2.5 |
| $110 | 84.0 | $2.7 |
| $120 | 85.4 | $2.9 |
| $130 | 86.7 | $3.0 |
| $140 | 88.0 | $3.2 |
| $150 | 89.2 | $3.3 |
| $160 | 90.4 | $3.5 |
| $170 | 91.6 | $3.6 |
| $180 | 92.7 | $3.7 |
| $190 | 93.8 | $3.9 |
| $200 | 94.8 | $4.0 |
Once we know how many wins to expect given a team's payroll, we can compare it to how many wins a team actually had to judge how effectively they spent their money:
| Lg | Team | Payroll | ExpW | AdjW | Diff |
| A | Tampa Bay Rays | $43,820,597 | 73 | 99 | 26 |
| A | Los Angeles Angels | $119,216,333 | 85 | 102 | 17 |
| A | Minnesota Twins | $56,932,766 | 76 | 90 | 14 |
| N | Florida Marlins | $21,811,500 | 69 | 82 | 13 |
| N | Chicago Cubs | $118,345,833 | 85 | 95 | 10 |
| A | Boston Red Sox | $133,390,035 | 87 | 97 | 10 |
| N | Milwaukee Brewers | $80,937,499 | 80 | 88 | 8 |
| N | Philadelphia Phillies | $98,269,880 | 82 | 90 | 8 |
| A | Toronto Blue Jays | $97,793,900 | 82 | 88 | 6 |
| A | Chicago White Sox | $121,189,332 | 86 | 91 | 5 |
| A | Cleveland Indians | $78,970,066 | 79 | 83 | 4 |
| N | Houston Astros | $88,930,414 | 80 | 84 | 4 |
| A | Texas Rangers | $67,712,326 | 78 | 81 | 3 |
| A | Oakland Athletics | $47,967,126 | 74 | 77 | 3 |
| N | Arizona Dbacks | $66,202,712 | 77 | 80 | 3 |
| N | St. Louis Cardinals | $99,624,449 | 82 | 84 | 2 |
| A | Kansas City Royals | $58,245,500 | 76 | 77 | 1 |
| N | New York Mets | $137,793,376 | 88 | 87 | -1 |
| N | Los Angeles Dodgers | $118,588,536 | 85 | 82 | -3 |
| A | New York Yankees | $209,081,577 | 96 | 91 | -5 |
| N | Colorado Rockies | $68,655,500 | 78 | 72 | -6 |
| N | Cincinnati Reds | $74,117,695 | 79 | 72 | -7 |
| A | Baltimore Orioles | $67,196,246 | 77 | 70 | -7 |
| N | San Francisco Giants | $76,594,500 | 79 | 70 | -9 |
| N | Pittsburgh Pirates | $48,689,783 | 74 | 65 | -9 |
| A | Detroit Tigers | $137,685,196 | 88 | 76 | -12 |
| N | Atlanta Braves | $102,365,683 | 83 | 70 | -13 |
| N | San Diego Padres | $73,677,616 | 79 | 61 | -18 |
| N | Washington Nationals | $54,961,000 | 75 | 57 | -18 |
| A | Seattle Mariners | $117,666,482 | 85 | 63 | -22 |
Obviously, the Rays were the cream of the crop last year. They spent very little money and won a lot of games. The strength of this system shines when looking at the second team on the list, however. The Angels spent a lot of money, but still won many more games than expected, something not recognized by a straight cost-per-win analysis, which ranked them tenth in efficiency.
Salary data from USA Today's Opening Day payroll database
25 comments
|
4 recs |
Do you like this story?
Comments
1990-2008
Here is what I get for that formula for 1990-2008:
2003 Tigers -34
2004 D’Backs -30
1998 Marlins -27
1993 Mets -26
1992 Dodgers -24
1996 Tigers -23
2008 Mariners -23
…
2008 Rays +24
1998 Yankees +27
1995 Indians +28
2002 A’s +28
2001 A’s +28
2001 Mariners +34
Great stuff
It’s interesting that between the Angels and Twins, spending the extra $63M gets you only an additional 9 expected wins. I wonder how this analysis looks over a number of years. It would be interesting to see a distribution of expected versus actual (adjusted) wins and the resulting difference. Over the years, is the number of expected wins a mean/median value compared to actual. If so, what is the deviation?
This is the type of analysis that demonstrates and quantifies the obvious correlation between payroll and wins.
Thanks Sky -- using this to determine Free Agent WAR costs
For a team to field just player from farm system and journey man (keep their player till arbitration is over) they will need between a 13 and 30 million dollar payroll. To be conservative we will go with the 30 million dollar number.
30 million = 70.9 wins
30 million * 30 teams = 900 million
30 teams * 70.9 wins = 2127 wins.
900 million/2127 wins = 423K/win
So total league payroll of last year was ~ 2.7 billion, after the minimums (900 million), it is 1.8 billion left to spend for those last 303 wins ((81*30)-2127) or 6 million/win.
Free agents will actually see more per win than the 2.2 million/win that some people recognize they deserve.
That was some pretty quick math there so let me know if there is any errors.
Where's the $2.2MM from?
$6MM per win for free agents obviously seems high. But, well, this analysis compares to average, not replacement-level, which is how player value should be handled.
Actually, if the $2.2MM is above average for free agents, it’s right on. $2.3MM per win above replacement for a $90MM payroll (from the table above) plus $2.2MM per win above average yields $4.5MM total for free agents above average, right where we were last off-season.
Beyond the Boxscore // Calling BJ Upton lazy is lazy.
When eval uating FA.
you are suppose to take WAR *2.2 million for the player’s salary.
Link
Commnet #20
I am not following your math
$90 million = 81.1 wins
$30 million = 70.9 wins
so 60 million to spend on 10.2 wins or 5.88 million/win
or am I wrong
by Jeff Zimmerman on Jan 20, 2009 2:00 PM EST up reply actions
FA's are getting paid about $4.5MM per marginal win. That link you provided is talking about $2.2MM per win for the average player, not just free agents.
Yes, the cost to increase wins is quite large. I’m still letting that sink in. Again, it’s because we’re using average as a baseline, not replacement. Or so I think.
Beyond the Boxscore // Calling BJ Upton lazy is lazy.
Here are the topand bottom teams for 2004-2008:
MIN +52
CLE +49
OAK +37
FLA +34
LAA +36
…
SFN -31
PIT -31
BAL -35
SEA -56
KCA -57
These are totals over those years, right? Or best/worst single-season numbers?
Beyond the Boxscore // Calling BJ Upton lazy is lazy.
If KC was averageish in its spending IQ last year...
…and yet is rock bottom over the last four, how crazy of an indictment of Allard Baird is this?
With the Royals coming up on $70m, or a bit more this year, and projected to win 79, does it seem like DMGM is again going to be just about average (or very slightly above) for one more season?
Of course, maybe DMGM could have spent the money a bit more wisely, and been slightly (rather than very slightly) above average. But it does seem to mitigate a little bit of the scorn poured on him for this offseason: he’s average!
Hail, anonymous mediocrity!
79 might be a bit high
if you look at the most recent CHONE-based community projection at Royals Review, although my earlier one did say around 79. Keep in mind that as bad as the Baird era was, that four of the five most valuable Royals in 2008 are Baird-era acquisitions, none of whom had reached arbitration yet.
It’s a tangled web, of course, but Moore is average at best, at this point, when you consider that Jose Guillen provided about 0.1 WAR last year and was the highest paid player on the team.
Bringing you more-or-less replacement level analysis and commentary since sometime in 2008.
by Matt Klaassen on Jan 21, 2009 1:46 PM EST up reply actions
The smart Yankee years, huh?
They aren’t in the bottom or top five in the later periods, though, either.
Cleveland and Oakland both appear in the top five 2 out of the 3 periods, too.
Are you using the BDB? If so, they must have salary data. I didn’t know that.
If you’re willing to do me a favor, I’d love a spreadsheet containing each team-season from, say, the past twenty years (or more, if it’s easy), their W-L record, payroll, the league’s average payroll, RS, and RA. I’ll create some trend charts using both actual record and Pythag record. Fans could point out where regime changes occurred.
Beyond the Boxscore // Calling BJ Upton lazy is lazy.
http://www.editgrid.com/user/dturkenk/team_salaries
Should be what you’re looking for.
by Dan Turkenkopf on Jan 22, 2009 8:33 AM EST up reply actions
it would be interesting to see this adjusted for strength of schedule, almost like BP’s 3rd Order Wins. using a metric like Pythag wins or 3rd order wins instead of “actual wins” would swing your results around. the Angels wouldn’t look nearly as good, the Red Sox/Yankees better, and the Rays completely off the charts
The formula...
I have read through this post and then the discussion from the link… but am still not certain what the 2 and the 5 represent in the formula… could someone explain?
It's a logistic function (or maybe pseudo-logistic?)
You can read about those here. A graph is helpful:
Focus on the right half the graph: an increase in money (the x-axis) yields more wins, but as you add more money, the wins increase at a slower rate.
Anyway, the 2 and the 5 are from trial and error to see what the best fit was over the past few years (click that Tango/Gassko link in the article for information). That’s the short answer. It does make sense that doubling the 2 and adding 1 yields 5, though:
Notice that if P (a team’s payroll) is exactly L (league-average payroll), then the equation reduces to 3L/6L = .500. Teams with league-aveage payroll are expected to win exactly half their games, so that makes sense. Also, as P gets much smaller than L, say half, you get 2.5L/5.5L = .455 win% at $45MM. But if you bump up L by 50% to $135MM, you get a win% of 3.5/6.5 = .538%, which is not symmetrical. Again, that should make sense. Increasing spending from $45MM to $90MM should be more beneficial than increasing from $90MM to $135MM.
Beyond the Boxscore // Calling BJ Upton lazy is lazy.
Hmm, evidently my picture-posting skills need work. Just click through the "here" link for it.
Beyond the Boxscore // Calling BJ Upton lazy is lazy.
Awesome.
The Rays really do have geniuses in the FO. I love how 6 teams spending over $100mil, including one over $200mil, finished in the red, while only 4 finished with more than expected wins. Although there are 3 other teams within $2mil of $100mil that finished with more than expected wins.
It’d be interesting to rank teams by how committed to sabermetrics they are, and then see how that compares to this list.
For those children who claimed they’ve been a fan of their favorite team all their life, or even since they were about four or five years old: bullshit. There’s always that certain event or certain player that draws to the sport and draws you to a team. For me, Nomar Garciaparra was that reason. - Nick Coviello: I Try To See Rocco, But All I Think Is Nomar; 1/9/09
I wonder how long it takes for the “effects” of smart management to reveal itself on this chart. The Rays were horrible forever, and then just jumped due to everything coming together at the same time. The Orioles did badly compared to how much money they spent, but how much of that is based on how crappy their farm system has been. Trend lines for each team would give a better idea of who gets lucky/unlucky and who is just smarter/dumber than everyone else, as well as which organizations seem to be heading in the right/wrong direction.
I agree trends are quite useful. Erosen's data above is quite interesting.
Beyond the Boxscore // Calling BJ Upton lazy is lazy.

by 


















