Navigation: Jump to content areas:


Pro Quality. Fan Perspective.
Login-facebook
Around SBN: Jeremy Lin And How The Pac-12 Missed Him

Non-Linear Cost-Per-Win Analysis

A month ago I wrote the classic Cost Per Marginal Win post, comparing each team's payroll above league minimum (about $13MM) to their win total above replacement (about 48 wins).  It's a nice approach, but actually only addresses a very specific question: "How much are teams spending per marginal win?"  While interesting, we often want to answer questions about front office comptetency. 

The main flaw in a straight cost-per-win analysis is that the first extra dollar spent on payroll is much more efficient than the 100-millionth extra dollar spent.  Florida, for example, barely spent more than they had to.  That money went to very small raises to good players in their first three years of team control (Dan Uggla made $27,000 more than the league minimum), first-year arbitration salaries (Alfredo Amazega made just under $1MM), and cheap, cost-efficient free agents (Jorge Cantu provided 2.8 WAR for $500K).  Players in those categories earn anywhere from literally nothing per marginal win to, say, $500K per marginal win.

On the other hand, the New York Yankees, with their $209MM payroll, spent the majority of their money on free agents.  Free agents are not good bargains, earning about $4.5MM per marginal win.  And while there's a good argument to be made for the Yankees mismanaging their money, there's no way they can spend that much money on payroll and not spend a lot of it on free agents.  There's only so much money to spend on cost-controlled and arbitration-eligible players.  If you want to spend more, you have to sign free agents.

To summarize, most teams need to spend more in order to win more games, but the more you spend, the less efficient each dollar is.  Starting at the cheapo end of the scale, here are some estimates of where extra money goes as more is spent, at what rate it's spent, and how good the team can expect to be:

  • The London McScrooges, minimum payroll: Money is spent exclusively on players in their first three years of service, at the league-minimum rate of $390,000 with minimal raises, if any at all.  Some replacement-level free agents might be signed.  The cost per win isn't much above zero.  Success isn't common, although the farm system should contain enough talent that this team is definitely better than replacement-level.  66 wins.
  • 1997 Tampa Bay Rays, $25MM: Extra money is spent on first-year arbitration players at about $1.8MM per marginal win (40% of FA rates).  Payroll isn't much more than with the Scrooges, but the extra money buys quite a few wins.  71 wins.
  • 1998 Colorado Rockies, $55MM : Extra money is spent on second and third year arbitration players at $2.7MM to $3.6MM per marginal win (60% and 80% of FA rates).  In addition, teams might buy out some free agent years at similar rates while buying out arbitration years (see the recent Evan Longoria and Dustin Pedroia contracts).  These teams are still below league-average payroll, but have a non-zero shot at a playoff spot given a strong crop of young players.  76 wins.
  • 2000s St. Louis Cardinals, $90MM: Extra money is spent on lower-level free agents who may come at a discount.  Teams take what they can get to fill holes without spending the full price of $4.5MM per free agent marginal win.  Big name free agents rarely fit the criteria.  At this point, teams are spending about the league average and winning a league average number of games.  81 wins.
  • New York Mets, $120MM.  Extra money is spent on bigger name free agents.  Holes are filled by Derek Lowe- and Adam Dunn-types instead of Jon Garland- and Garret Anderson-types.  This spending isn't very efficient ($4.5MM per marginal win compared to the overall average of $2.7MM per marginal win) but going from 81 wins to 86 wins leads to a significant increase in playoff probability.  86 wins.
  • Boston Red Sox to New York Yankees, $160M to $210MM.  Extra money is spent on the best of the best.  Because there are a limited number of players who will contribute on the field, it's worth overspending on star players.  Obviously, there's a huge payroll gap between the Red Sox and Yankees.  If the two teams were equally intelligent, you'd expect about 91 wins from a payroll the size of Boston's and 96 wins from New York's $200MM+ payroll.  That the Sox have kept pace with the Yankees for the last five years is a testament to Theo Epstein and company.

So what we need now is a model of how the cost-per-win changes the more money a team spends.  Thankfully, David Gassko and Tom Tango have done some work in this regard, and I'm going to borrow their result:

ExpWins = (P + 2*L) / (P + 5*L) * 162

P is team payroll and L is league-average payroll.  The model is basically saying "Given a front office with average ability, how many wins would you expect out of a team that spends P on their payroll?"   Here's the effective cost-per-win at various payroll levels given the model:

Payroll $MM ExpW Cost Per Win
$13 67.5 $0.0
$20 69.0 $0.3
$30 70.9 $0.7
$40 72.8 $1.1
$50 74.6 $1.4
$60 76.3 $1.7
$70 77.9 $1.9
$80 79.5 $2.1
$90 81.1 $2.3
$100 82.6 $2.5
$110 84.0 $2.7
$120 85.4 $2.9
$130 86.7 $3.0
$140 88.0 $3.2
$150 89.2 $3.3
$160 90.4 $3.5
$170 91.6 $3.6
$180 92.7 $3.7
$190 93.8 $3.9
$200 94.8 $4.0

Once we know how many wins to expect given a team's payroll, we can compare it to how many wins a team actually had to judge how effectively they spent their money:

Star-divide

Lg Team Payroll ExpW AdjW Diff
A Tampa Bay Rays  $43,820,597 73 99 26
A Los Angeles Angels  $119,216,333 85 102 17
A Minnesota Twins  $56,932,766 76 90 14
N Florida Marlins  $21,811,500 69 82 13
N Chicago Cubs  $118,345,833 85 95 10
A Boston Red Sox  $133,390,035 87 97 10
N Milwaukee Brewers  $80,937,499 80 88 8
N Philadelphia Phillies  $98,269,880 82 90 8
A Toronto Blue Jays  $97,793,900 82 88 6
A Chicago White Sox  $121,189,332 86 91 5
A Cleveland Indians  $78,970,066 79 83 4
N Houston Astros  $88,930,414 80 84 4
A Texas Rangers  $67,712,326 78 81 3
A Oakland Athletics  $47,967,126 74 77 3
N Arizona Dbacks  $66,202,712 77 80 3
N St. Louis Cardinals  $99,624,449 82 84 2
A Kansas City Royals  $58,245,500 76 77 1
N New York Mets  $137,793,376 88 87 -1
N Los Angeles Dodgers  $118,588,536 85 82 -3
A New York Yankees  $209,081,577 96 91 -5
N Colorado Rockies  $68,655,500 78 72 -6
N Cincinnati Reds  $74,117,695 79 72 -7
A Baltimore Orioles  $67,196,246 77 70 -7
N San Francisco Giants  $76,594,500 79 70 -9
N Pittsburgh Pirates  $48,689,783 74 65 -9
A Detroit Tigers  $137,685,196 88 76 -12
N Atlanta Braves  $102,365,683 83 70 -13
N San Diego Padres  $73,677,616 79 61 -18
N Washington Nationals  $54,961,000 75 57 -18
A Seattle Mariners  $117,666,482 85 63 -22

Obviously, the Rays were the cream of the crop last year.  They spent very little money and won a lot of games.  The strength of this system shines when looking at the second team on the list, however.  The Angels spent a lot of money, but still won many more games than expected, something not recognized by a straight cost-per-win analysis, which ranked them tenth in efficiency.

Salary data from USA Today's Opening Day payroll database

Comment 25 comments  |  4 recs  | 

Do you like this story?

More from Beyond the Box Score

Comments

Display:

1990-2008

Here is what I get for that formula for 1990-2008:

2003 Tigers -34
2004 D’Backs -30
1998 Marlins -27
1993 Mets -26
1992 Dodgers -24
1996 Tigers -23
2008 Mariners -23

2008 Rays +24
1998 Yankees +27
1995 Indians +28
2002 A’s +28
2001 A’s +28
2001 Mariners +34

by erosen on Jan 20, 2009 12:40 PM EST reply actions  

Great stuff

It’s interesting that between the Angels and Twins, spending the extra $63M gets you only an additional 9 expected wins. I wonder how this analysis looks over a number of years. It would be interesting to see a distribution of expected versus actual (adjusted) wins and the resulting difference. Over the years, is the number of expected wins a mean/median value compared to actual. If so, what is the deviation?

This is the type of analysis that demonstrates and quantifies the obvious correlation between payroll and wins.

by Adam Peterson on Jan 20, 2009 12:41 PM EST reply actions  

Thanks Sky -- using this to determine Free Agent WAR costs

For a team to field just player from farm system and journey man (keep their player till arbitration is over) they will need between a 13 and 30 million dollar payroll. To be conservative we will go with the 30 million dollar number.

30 million = 70.9 wins

30 million * 30 teams = 900 million

30 teams * 70.9 wins = 2127 wins.

900 million/2127 wins = 423K/win

So total league payroll of last year was ~ 2.7 billion, after the minimums (900 million), it is 1.8 billion left to spend for those last 303 wins ((81*30)-2127) or 6 million/win.

Free agents will actually see more per win than the 2.2 million/win that some people recognize they deserve.

That was some pretty quick math there so let me know if there is any errors.

by Jeff Zimmerman on Jan 20, 2009 1:09 PM EST reply actions  

Where's the $2.2MM from?

$6MM per win for free agents obviously seems high. But, well, this analysis compares to average, not replacement-level, which is how player value should be handled.

Actually, if the $2.2MM is above average for free agents, it’s right on. $2.3MM per win above replacement for a $90MM payroll (from the table above) plus $2.2MM per win above average yields $4.5MM total for free agents above average, right where we were last off-season.

Beyond the Boxscore // Calling BJ Upton lazy is lazy.

by Sky Kalkman on Jan 20, 2009 1:39 PM EST up reply actions  

When eval uating FA.

you are suppose to take WAR *2.2 million for the player’s salary.

Link
Commnet #20

I am not following your math

$90 million = 81.1 wins
$30 million = 70.9 wins

so 60 million to spend on 10.2 wins or 5.88 million/win

or am I wrong

by Jeff Zimmerman on Jan 20, 2009 2:00 PM EST up reply actions  

Here are the topand bottom teams for 2004-2008:
MIN +52
CLE +49
OAK +37
FLA +34
LAA +36

SFN -31
PIT -31
BAL -35
SEA -56
KCA -57

by erosen on Jan 20, 2009 1:31 PM EST reply actions  

If KC was averageish in its spending IQ last year...

…and yet is rock bottom over the last four, how crazy of an indictment of Allard Baird is this?

With the Royals coming up on $70m, or a bit more this year, and projected to win 79, does it seem like DMGM is again going to be just about average (or very slightly above) for one more season?

Of course, maybe DMGM could have spent the money a bit more wisely, and been slightly (rather than very slightly) above average. But it does seem to mitigate a little bit of the scorn poured on him for this offseason: he’s average!

Hail, anonymous mediocrity!

by Sean O Se on Jan 20, 2009 2:00 PM EST up reply actions  

79 might be a bit high

if you look at the most recent CHONE-based community projection at Royals Review, although my earlier one did say around 79. Keep in mind that as bad as the Baird era was, that four of the five most valuable Royals in 2008 are Baird-era acquisitions, none of whom had reached arbitration yet.

It’s a tangled web, of course, but Moore is average at best, at this point, when you consider that Jose Guillen provided about 0.1 WAR last year and was the highest paid player on the team.

Bringing you more-or-less replacement level analysis and commentary since sometime in 2008.

by Matt Klaassen on Jan 21, 2009 1:46 PM EST up reply actions  

Same 1999-2003
OAK 106
SFN +60
SEA +58
ATL54
CHA +35

MIL -45
TEX -50
TBA -64
BAL -65
DET -79

by erosen on Jan 20, 2009 1:33 PM EST reply actions  

1994-1998:
ATL +61
CLE +57
NYY +54
HOU +38
MON +37

FLO -25
MIN -28
TOR -32
PHI -38
DET -44

by erosen on Jan 20, 2009 1:37 PM EST reply actions  

The smart Yankee years, huh?

They aren’t in the bottom or top five in the later periods, though, either.

Cleveland and Oakland both appear in the top five 2 out of the 3 periods, too.

Are you using the BDB? If so, they must have salary data. I didn’t know that.

If you’re willing to do me a favor, I’d love a spreadsheet containing each team-season from, say, the past twenty years (or more, if it’s easy), their W-L record, payroll, the league’s average payroll, RS, and RA. I’ll create some trend charts using both actual record and Pythag record. Fans could point out where regime changes occurred.

Beyond the Boxscore // Calling BJ Upton lazy is lazy.

by Sky Kalkman on Jan 21, 2009 9:59 AM EST up reply actions  

it would be interesting to see this adjusted for strength of schedule, almost like BP’s 3rd Order Wins. using a metric like Pythag wins or 3rd order wins instead of “actual wins” would swing your results around. the Angels wouldn’t look nearly as good, the Red Sox/Yankees better, and the Rays completely off the charts

by makewayhomer on Jan 20, 2009 2:06 PM EST reply actions  

The formula...

I have read through this post and then the discussion from the link… but am still not certain what the 2 and the 5 represent in the formula… could someone explain?

by AndyB83 on Jan 20, 2009 6:42 PM EST reply actions  

It's a logistic function (or maybe pseudo-logistic?)

You can read about those here. A graph is helpful:

Focus on the right half the graph: an increase in money (the x-axis) yields more wins, but as you add more money, the wins increase at a slower rate.

Anyway, the 2 and the 5 are from trial and error to see what the best fit was over the past few years (click that Tango/Gassko link in the article for information). That’s the short answer. It does make sense that doubling the 2 and adding 1 yields 5, though:

Notice that if P (a team’s payroll) is exactly L (league-average payroll), then the equation reduces to 3L/6L = .500. Teams with league-aveage payroll are expected to win exactly half their games, so that makes sense. Also, as P gets much smaller than L, say half, you get 2.5L/5.5L = .455 win% at $45MM. But if you bump up L by 50% to $135MM, you get a win% of 3.5/6.5 = .538%, which is not symmetrical. Again, that should make sense. Increasing spending from $45MM to $90MM should be more beneficial than increasing from $90MM to $135MM.

Beyond the Boxscore // Calling BJ Upton lazy is lazy.

by Sky Kalkman on Jan 21, 2009 9:54 AM EST up reply actions  

Awesome.

The Rays really do have geniuses in the FO. I love how 6 teams spending over $100mil, including one over $200mil, finished in the red, while only 4 finished with more than expected wins. Although there are 3 other teams within $2mil of $100mil that finished with more than expected wins.
It’d be interesting to rank teams by how committed to sabermetrics they are, and then see how that compares to this list.

For those children who claimed they’ve been a fan of their favorite team all their life, or even since they were about four or five years old: bullshit. There’s always that certain event or certain player that draws to the sport and draws you to a team. For me, Nomar Garciaparra was that reason. - Nick Coviello: I Try To See Rocco, But All I Think Is Nomar; 1/9/09

by bdalebs on Jan 20, 2009 8:36 PM EST reply actions  

I wonder how long it takes for the “effects” of smart management to reveal itself on this chart. The Rays were horrible forever, and then just jumped due to everything coming together at the same time. The Orioles did badly compared to how much money they spent, but how much of that is based on how crappy their farm system has been. Trend lines for each team would give a better idea of who gets lucky/unlucky and who is just smarter/dumber than everyone else, as well as which organizations seem to be heading in the right/wrong direction.

by math_geek on Jan 20, 2009 11:45 PM EST reply actions  

Totally rec’d this. Great work, Sky.

by xanthan on Jan 21, 2009 11:04 AM EST reply actions  

Comments For This Post Are Closed


User Tools

We use numbers and stuff.
Community Guidelines
Why be a member?

FanPosts

Community blog posts and discussion.

Recent FanPosts

Small
Prince Fielder in Comerica Park
Crystal_ball_small
Sparky vs Buck
Img_3830_small
BtBS Fantasy League
Small
Context Neutral Run and RBI projections
Small
Free Agent Compensation
Img_0001_small
Value of Various Plate Approaches
Strike_three2_small
Effect of Foul Area on Strikeouts: AL 1954-68: Erratum
Small
Baseball on a stick
Small
Player Evaluating Statistic
Baseball_small
Rays Outfield: Cheap but Extremely Productive

+ New FanPost All FanPosts >

Follow us on Facebook!

Follow us on Twitter!

SaberGraphics

MLB Daily Dish

Get the latest MLB Trade Rumors, Transactions, and News at MLB Daily Dish!


Managing Editor:

Jbopp-kc_small Justin Bopp

Columnists:

Adam_small adarowski

Dme_small Satchel Price

Closeup4_small J-Doug

Carlosicon_small Julian Levine

Billy_and_daddy_4th_of_july_small Bill Petti

Featuring:

Dayton_small Jeff Zimmerman

12475953_small Jacob Peterson

Picture-6_small Chris St. John

Btbpro_small Dave Gershman

229331_10150183361996591_674441590_6760167_6637860_n3_small Lewie Pollis

Img_3830_small David Fung