Beyond the Box Score: An SB Nation Community

Navigation: Jump to content areas:


Sports blogs for fans, by fans.
New Blog: World Soccer Digest for Soccer Fans!

BtB Power Ranking Season Review: NL West

Matt Cain thinks the Giants' 23rd placement in the BtB Power Rankings is crap!  (He thinks the same about his FIP, xFIP, and tRA*.)  But can there be justification for ranking a contending team so poorly?  Read on...

More photos » by Darren Hauck - AP

Matt Cain thinks the Giants' 23rd placement in the BtB Power Rankings is crap! (He thinks the same about his FIP, xFIP, and tRA*.) But can there be justification for ranking a contending team so poorly? Read on...

In our final installment of of the BtB Power Rankings posts of 2009 (aside from some possible methodological work I'll do this offseason), we look at the NL West.  Below, W% = true winning percentage, pW% = pythagenpat winning percentage, and cW% = component W% (the basis of these rankings).  All of the data I reference can be found in the final Power Rankings post of 2009.

 

4. Colorado Rockies.  TQI = 0.572

One of the things I was happiest about this season with respect to the power rankings was how quickly they picked up on the Rockies "Jim Tracy" turnaround.  On June 3rd, just as Hurdle was fired, they were down to 22nd in the rankings.  But on June 17th, they were picked as the NL Wild Card leaders--a spot they held for most of the rest of the season, except near the end of the September, when they actually passed the Dodgers (note, though, that there is no meaningful difference between the Rockies' and Dodgers' TQI estimates).  

In contrast, it wasn't until July 20th that they passed the Giants for the first time in the actual standings.  The Rockies offense and fielding were roughly average--this team was all about its pitching.  Perhaps it's the park factors I'm using, or something balky about my implementation of the stat itself, but tERA rates their staff better than any other in the league by a substantial margin: 3.56 vs. the 3.81 tRA Cubs.  FIP isn't quite so liberal (3.84 FIP ranks 3rd in the league), so I may be overrating them a bit...but I stand by the argument that their pitching staff was one of the best in the league.  And with that pitching staff, they ranked at the top of the National League.

Star-divide

5. Los Angeles Dodgers.  TQI = 0.567

The Dodgers started this season on a tear, and, despite the league adjustment penalty, were the only National League team to ever rank at the top of the power rankings.  They leveled off a bit, but remained dominant all year long.  They were the best balanced NL team of 2009.  They ranked 3rd in the league in wOBA (including all baserunning), 2nd in FIP, 3rd in tERA, and 4th in fielding. Essentially, this was a team that excelled in every aspect of the game.  Their cW% (0.593) is a close match for their actual record (0.586), despite their pW% being a bit higher--we estimated that they were a bit lucky in their number of runs allowed, which counters the degree to which they fell short of their pythagorean record.  Despite ranking behind the Rockies, this, to me, is the best team in the league.  Whether they can beat the Phillies in a best-of-7 playoff series remains to be seen--as I write this, it's 4-2 in the 6th inning, which, if it holds, would tie the series at 2 games each.

 

19. Arizona Diamondbacks.  TQI = 0.481

cW% has the D-backs as a 0.500+ team, despite their 0.432 record.  pW%'s in between at 0.462. The big factor here was defense--the power rankings estimate 677 runs allowed compared to 745 actual runs allowed (after park adjustments).  That's a mind-bogglingly large difference.  The Diamondbacks were an average to above-average fielding team, so we'd expect their ERA to be at or better than fielding-independent stats.  And yet their ERA was 4.44 compared to a 4.13 FIP and a 3.95 tERA.  Part of that is park effects at the babip-inflating Chase field, as I'm not park-adjusting that ERA number like I did for the other two.  But part of it may just be bad luck.  I like the Diamondbacks to rebound a bit next year.  Not sure if they can unseat the Dodgers, and the Rockies should still be quite good.  But this is a team that could be back in the thick of it if a few things go their way.

 

23. San Francisco Giants.  TQI = 0.441

Here's the thing.  If you decide to sit down to try to produce a different kind of ranking system, especially one that uses different methodologies that most other systems, you're almost guaranteed that there will be one team that will rank in a vastly different way than most people think it should be ranked.  For these power rankings, the Giants are that team, and I've received no end of crap for it since June.

Let's walk through what is happening here step by step.

Offense.  The Giants' estimated runs scored, based on park adjusted wRC and BPro's EqBRR numbers, come in 40 runs shy of their actual runs scored.  Why?  Much of it is probably timing: the Giants have the second-highest clutch rating at FanGraphs (+29 runs).  As for the rest, I don't know--perhaps "clumping" of hits together that isn't picked up by clutchiness?

Defense.  The Giants' estimated runs allowed, based on tERA and fielding measures (including catchers), comes in 47 runs higher than their actual runs allowed.  Why?  The Giants' tERA was 4.00, almost a full half-run above their team ERA of 3.55.  SFG park factor is 1.01, so let's push their ERA total down to 3.51 in recognition of the park factor.  So we have a half-run difference per nine innings.  That works out to ~80 earned runs per season difference (~86 runs), which is an enormous disparity.  A big part of that is fielding, though--the Giants rate here as the second-best fielding team in the National League at ~34 to 47 runs above average (bUZR = +53 runs, THT = +40 runs, Catching = -6 runs).  The other 39 to 52 run difference, though, remains unexplained.  

You could argue it's my implementation of tERA, but their FIP (as I calculate it, which has a park factor for HR rate) was 3.93, which would amount to only a slight improvement.  And since their HR/Fly% was dead-on league average (11%), xFIP wouldn't be different (though I don't have that number specifically calculated to be sure).  Given all of this, if we're going to be consistent in how we read the numbers, I think the defense simply got lucky by ~45 runs or so.

You can look through their pitchers and see where some of this is coming from.  Matt Cain had a fine season, for example, but his FIP (3.86) and xFIP (4.26) were much higher than his sparkly ERA (2.89).  Similar things occur when you look at top relievers Brandon Medders (3.01 ERA vs. 3.91 FIP & 4.39 xFIP), Jeremy Affeldt (1.73 ERA vs. 3.50 FIP & 3.54 xFIP), and Justin Miller (3.18 ERA vs. 4.86 FIP & 5.04 xFIP).  Most observers, looking at those numbers, would think that those pitchers got a bit lucky this season.  What we're seeing, I think, is the summed "luckiness" of those pitchers, which pushes the overall team defense numbers to look "lucky."

Given our estimates of runs scored and runs allowed, we get an expected component W% of 0.470.  That's obviously a far cry from their pW% of 0.533, much less their actual W% of 0.543.  But the reason is apparent "luckiness" (timing, clutchiness, or what have you) on both offense and defense.  Based on these numbers, this Giants team may have overachieved by something like 12 wins (plus or minus a few).  Add to that our league adjustments (which are applied in the same way to all NL teams, and are based, in part, on interleague records), and you have fodder for a lot of outraged Giants fans.

 

27. San Diego Padres

The Padres had another positively forgettable season, which ended in the ouster of their GM.  Even after park adjustments for the extreme PetCo field, the Padres offense ranked as below average, while their fielding and pitching were both somewhere between slightly to comfortably below average.  Their actual W% (0.463) is higher than their pW% (0.427) and cW% (0.412), indicating that as bad as it was over the course of the season, they probably got a bit lucky to perform as well as they did.  They ranked near or at the bottom of the rankings all season long, and only the late-season falls of the Nationals, Astros, and Pirates kept them out of the cellar on the season.

 

Well, that's it for the 2009 power rankings.  We're planning to do this again next year, hopefully with more careful strength of schedule adjustments among other incremental improvements.  Hope you found these an interesting, alternative way to look at team performance this season.

BtB Power Rankings 2009 End of Season Data

Team by Team reviews: AL East | AL Central | AL West | NL East | NL Central | NL West

0 recs  |  Comment 25 comments |

Story-email Email Printer Print

Comments

Display:

Luck o' the G-men

Watching my beloved Giants this year win 88 games (I was hoping-against-hope we’d be a .500 club) got me thinking a LOT about luck, clutchiness, intangibles, you-name-it. I think the rankings are pretty fair, actually. The Giants had a minor-league offense and had no business “contending.” The fact that they did says “luck” to me, but that also discounts the impact of a guy like Tim Lincecum. He’s the most valuable player in the league (other than Albert Pujols), and his back-to-back Cy Young-caliber seasons rescued this squad from ignominy. I like to think he added 10 actual wins to our total both this year and last. Nothing analytical or sabermetric about that claim, just a bit of awe over our young stud. I think the fan base will be in for a rude shock in 2010 if the lineup isn’t completely re-tooled, though.

Raising Matt Cain

Todos somos Gigantes

by MarkOC on Oct 21, 2009 10:12 AM EDT reply actions   0 recs

Agreed

He’s actually looking like he’s first on mine, but I’m recalculating things and I don’t know if I’m doing it right. Either way, Lincecum’s been a beast.

by SFiercex4 on Oct 21, 2009 12:03 PM EDT up reply actions   0 recs

I had Lincecum 2nd for MVP as well

Obvious first choice for the Cy Young as far as I’m concerned. Unbelieveable talent and performance.

And to think, the Reds picked Drew Stubbs in front of him. I’m going to complain about that for the rest of Lincecum’s career. :)

How soon until we see pitchers start to mimic his delivery?
-j

by JinAZ on Oct 21, 2009 12:52 PM EDT up reply actions   0 recs

Better Stubbs than Greg Reynolds

"I have no special talents. I am only passionately curious." - Albert Einstein

by Poseidon's Fist on Oct 27, 2009 2:54 AM EDT up reply actions   0 recs

Giants pitchers were the third-most clutch group int he majors at about 5 wins.

http://www.fangraphs.com/teams.aspx?pos=all&stats=pit&lg=all&type=3&season=2009&month=0

Just starters (removing bullpen leverage, which is more of a real skill): 4th most clutch at 2.5 wins

http://www.fangraphs.com/teams.aspx?pos=all&stats=sta&lg=all&type=3&season=2009&month=0

There IS reason to believe pitchers are “clutch” — they can control where and what they throw, keeping the ball lower to avoid HRs and being more willing to walk hitters with men already on base, for example. But there’s surely also a lot of luck as to how events interact.

by Sky Kalkman on Oct 21, 2009 10:13 AM EDT reply actions   1 recs

I have nothing against the Giants.

I actually have enjoyed watching Sabean make some smarter moves recently (note the some) and I enjoy watching/rooting for guys like Timmay, Winn, and Rowand.

But I’m happy to put my pride on the line and make an avatar bet with anyone who doesn’t buy these rankings and take the under on almost any team wins O/U. We’d have to take into account any major roster changes and pretty much use a base O/U number near this year’s win total. Any takers? I already have some nice sparkly pony avatars picked out for you…

by Sky Kalkman on Oct 21, 2009 10:31 AM EDT reply actions   0 recs

I will say, I do think something in your methodology is underrating the Giants. I don’t think they were even close to 88 wins this year – they were definitely lucky in both run prevention and run scoring – I’d say they were more like an 82 win team. Even then we’re still looking at an 8 win difference between what a couple of other methodologies I’ve seen have them at and what you have them at. That’s a huge discrepency. Anyways we’ve had the conversation before, so I don’t see a need to go into any more detail or anything…

I thought it was interesting that the Giants pitching staff had a league average HR/FB%. I don’t know where to find component park adjustments, but I’m under the impression AT&T pretty heavily suppresses HR’s, so I’d expect their HR/FB% to actually beat league average.

by Missing Barry on Oct 21, 2009 1:21 PM EDT up reply actions   0 recs

tERA...

…as I calculate it specifically looks at HR/FB%, and includes a park correction for this variable (courtesy of David Gassko). You’re right that AT&T severely depresses HR rates (from memory, it’s like 0.88 or something absurd like that). This means that I’m adding HR to Giants pitcher totals to adjust their pitchers into a neutral park (AT&T suppresses homers, so they likely would allow more if pitching in a neutral park).
-j

by JinAZ on Oct 22, 2009 1:29 PM EDT up reply actions   0 recs

Ah, so what their league average number says is they gave up pretty much exactly the expected amount of HR’s/FB’s, right?

by Missing Barry on Oct 22, 2009 4:42 PM EDT up reply actions   0 recs

Yes, if expected = league average

And since they pitch in a pitcher-friendly park (at least with respect to HR’s), they probably were a bit homer prone per fly ball. That’s actually a good thing for them, as that’s not a number that repeats from season to season (i.e. they might have gotten a bit unlucky in their homer rate).

This, frankly, is one of the reasons I’m thinking about going to xFIP next year instead of tRA. tRA is fielding independent, and it’s park adjusted, but it does not adjust for some of the batted ball events (like HR/FB, or even LD) that can make a big difference in a pitcher’s line but don’t provide much prediction. tRA* would be preferable because it uses more events and regresses them properly. But I can’t calculate that myself (unless I go nuts with gameday this offseason), so xFIP becomes my best option if I want to go after true talent a bit more…
-j

by JinAZ on Oct 22, 2009 9:14 PM EDT up reply actions   0 recs

I don’t have a huge grudge against these rankings, but this is too good a chance to pass up. You’re going to be sporting one of Grant’s un-propaganda Giants images for an avatar by the end of next season.

My O/U: 79.5 wins.
We’ll adjust it down when Sabean signs Jermaine Dye, but leave it as is if he re-signs crappy players who were already on the team (like Bengie Molina).

Please hit better, Randy Winn.

by oldjacket on Oct 22, 2009 12:00 PM EDT up reply actions   0 recs

No dice.

The Giants won 88 games this year, these ranking put them at 76 win talent. You’re offering 79.5? That’s 3.5 games away from the rankings and 8.5 away from their 2009 record. If everyone agrees that these rankings are over twice as indicative of the Giants talent this year as their record, then I’d already consider it a win. I’m looking for people to stand up for the idea that the 88 wins are at least as indicative as the rankings.

by Sky Kalkman on Oct 22, 2009 9:55 PM EDT up reply actions   0 recs

I don’t think you’ll find many takers on that one. Most Giants fans are quite willing to accept that the Giants over-performed. We just think they were an 80-83 win team, not a 76 win team.

Please hit better, Randy Winn.

by oldjacket on Oct 23, 2009 10:06 AM EDT up reply actions   0 recs

Yeah, we’ve basically accepted that we weren’t an 88 win team. I added up the WAR from Fangraphs and, if I did it right, we should have been an 80 win team by their methodology. Do you know why your method was so far off theirs? It’d definitely be interesting to get into the details of what differed so much between the two methods.

by Missing Barry on Oct 23, 2009 2:35 PM EDT up reply actions   0 recs

Just to elaborate a little bit it looks to me like the Giants scored 11 runs on offense your model here doesn’t account for (I’m assuming “clutch” accounts for 29 additional runs scored by a better than expected situational hitting, so I factored those out to luck)? There’s also about 45 runs or so (as you mentioned in the post) that the Giants prevented that your model doesn’t predict – do you have any explanations on what the root cause for this might be?

by Missing Barry on Oct 23, 2009 2:48 PM EDT up reply actions   0 recs

I'm confused on whether you're talking WAR numbers or real numbers

But anyway:

Offense is wRC (park corrected), minus the SB stuff from wRC, plus BPro’s baserunning stats (which are very favorable to the Giants). If you’re getting a disparity, it might be the park correction—I’m using a 1.01 runs park factor on wRC from Patriot’s work.

Pitching uses tERA, which is similar to FIP (which is what FanGraphs’ WAR uses, I think) but not quite the same thing. FanGraphs’ FIP uses no park correction (right?) for HR’s, and thus is a bit lower than I think it should be given the HR-suppressing effect of AT&T. That’s probably a big part of the reason there’s a difference.

I’m also using catching fielding numbers, which FanGraphs ignores, and the Giants trail there by a half-win or so.

Finally, I’m using both bUZR from fangraphs as well as THT’s team-level fielding stat. Both agree that Giants were plus, but THT has them at +40 instead of bUZR at +53. I’m averaging those two. But the result is another half-win or so deduction from the Giants’ estimate.

Hope that helps. -j

by JinAZ on Oct 23, 2009 3:18 PM EDT up reply actions   0 recs

Sorry I guess I was mixing up Fangraphs and actual at various points. What I’m really concerned about is the 4 win difference between Fangraphs and you guys. As best as I can tell, the difference from catchers runs, baserunning, and FIP/tRA explains a net total of about 5 runs or so, still leaving about 3.5 wins unexplained. So I guess with the defense difference its more like 3 wins. I’m just wondering where those 3 wins might come from.

Actually as I think about it I’m curious where the difference in actual and predicted might come from, too. It seems there are a lot of runs that are unexplainable beyond the normal lucky factors like situational hitting. I’m counting 11 on offense and the ~45 or so you identified in the post on defense.

Hope that was more clear, thanks.

by Missing Barry on Oct 23, 2009 3:51 PM EDT up reply actions   0 recs

Um

The difference in tRA and FIP is .07 runs per 9, which accounts for about -11 runs. The catcher defense accounts for -6 runs, the averaging out UZR and THT stats accounts for -7 runs, and the baserunning is +10 runs.

That’s a total difference of about 1.5 wins. I am curious where the rest of them went Justin. It’s not really a big deal, but I know that David uses Patriots park factors as well. He may not be adjusting for HR’s in tRA though.

by vivaelpujols on Oct 25, 2009 2:30 PM EDT up reply actions   0 recs

I'm calculating it myself (hence the "home brew" description in the table legends)

It isn’t as good as using the real data from statcorner, as I have to fudge some things since I don’t have a pbp database hooked up to this stuff right now. But I can’t get excel to pull data from statcorner because of the way that site presents its data, and I’m not going to type it in for each team each week. Next year, I may be able to pull it from fangraphs once they implement it on the team pages.

I’ve done some quality control checks, though, and I’ve found that what I’m calculating a) matches up to tRA at statcorner well most of the time, and b) it correlates extremely well with FIP despite the different methodologies. I’m not super concerned about it on a grand level, though the Rockies probably are a case where my bastardization of tRA doesn’t work as well as the “real” version at statcorner.
-j

by JinAZ on Oct 21, 2009 12:50 PM EDT up reply actions   0 recs

I'm just wondering

Maybe the reason the Giants ranked so low is the fact that when you’re calculating power rankings, the only information you have to look at is past performance, which doesn’t account for player improvement or rookies/players with little major league service. There were a bunch of players who didn’t have much major league experience (Sandoval, Velez, Torres, Burriss, Ishikawa, Schierholtz, Sadowski, Martinez, Posey, Bumgarner) or made significant improvements over past years (Cain, yes he was better, though not 2.89 ERA better, J. Sanchez, Uribe, Medders, Affeldt, again not THAT good, but good). Basing an evaluation of this team on past performance, a 76 win team is definitely understandable. But half our roster had career years, which was no doubt due in a large part to luck. The problem is that IMO these prediction models can’t handle the idea of a player busting out and doing far better than he has in the past, either randomly or because he’s made an adjustment, so when a player does that they get confused. It works similarly in the opposite direction; traditionally good players who have down seasons boost their team more in models than in the real world.

Considering this and the “luck” factor I can understand a 76 win prediction. The Giants just managed to take advantage of the imperfection of modeling: its assumption that players will perform to previous levels.

O/U next year I’ll take 83 wins. Sabean’s going to do SOMETHING, even if it’s a full year of Freddy Sanchez, that’ll make the offense better. The pitching won’t be as good, but Lincecum and Cain are legitimate aces, Zito and Sanchez seem to have done something, and I wouldn’t put it past our bullpen to get even better next year, so there probably won’t be an enormous drop-off.

by quincy0191 on Oct 23, 2009 7:08 PM EDT reply actions   0 recs

This system doesn't care about past performance.

It only cares about what you’ve done this season and tries to strip the skill part of it from the non-skill part of it.

In addition to an U/O avatar bet somewhere near 85 wins (although it’s seeming more and more like Giants fans think this is a 80-83 win team next year) I’ll take an avatar bet on Matt Cain’s ERA next year, probably taking the over. He’s not a legit ace at all, if you look at his peripherals. Good pitcher, yes. Ace, no.

by Sky Kalkman on Oct 24, 2009 7:29 AM EDT up reply actions   0 recs

I’ll take an avatar bet on Matt Cain’s ERA next year, probably taking the over. He’s not a legit ace at all, if you look at his peripherals. Good pitcher, yes. Ace, no.

I think most Giants fans (the ones you find through the blogosphere, at least) realize this point, too. Cain’s been the exact same pitcher for the last 4 years – which is a very good pitcher, but not even close to someone like Lincecum. His consistency is pretty impressive, though.

by Missing Barry on Oct 26, 2009 1:16 PM EDT up reply actions   0 recs

Comments For This Post Are Closed


User Tools

We use numbers and stuff.
Community Guidelines
Why be a member?
Start posting on Beyond the Box Score »

Join SB Nation and dive into communities focused on all your favorite teams.

FanPosts

Community blog posts and discussion.

Recommended FanPosts

Small
PZR-based Win Values 2001-2006

Recent FanPosts

Small
Determining Batted Ball Rates using Pitch Type and Location
Small
a new xBABIP calculator
Img587561916661595
Top 15 high school MLB draft prospects
Small
The "30 parks on a budget" challenge
Sunflower_small
World Series Simulation, Game #6
Small
JT20 Dynasty League
E52205a2_small
New Look
Sth70021_small
Exploring Hit f/x, Albeit Badly
Redcap_small
Ricky Nolasco: 4 WAR or 1 WAR?

+ New FanPost All FanPosts >

FanShots

Quick hits of video, photos, quotes, chats, links and lists that you find around the web.

Recent FanShots

Primer on BaseRuns
Cool Baseball Infographics
ESPN's Jerry Crasnick on defensive metrics
I’m also a follower, since Brian Bannister’s on our team, of sabermetric st...
Top Ten Baseball-Reference.com's Sponsorships
Primer on Linear Weights
JC Bradbury on "Hot Stove Myths"
Everyone Should Learn to Throw a Cutter
Criminals of WAR
Ten statisticians you should know about

+ New FanShot All FanShots >

BtB on Twitter

Main Feed: @BtBScore

Tommy B: @tommy_bennett
Sky: @BtB_Sky
Dan: @dturkenk
Harry: @harrypav
Jinaz: @jinazreds
Jack: @jh_moore
Erik: @Erik_Manning
Tommy R: @trancel
Justin: @justinbopp

Subscribe to BtB via Email

Enter your email address:

Delivered by FeedBurner

BtB Goes Social


Managers

Nando_small R.J. Anderson

Limes_125_small Sky Kalkman

E52205a2_small Tommy Bennett

Editors

Face_small Harry Pavlidis

Rawlings_baseball_bigger_small Dan Turkenkopf

770insig_small Jeff Zimmerman (TucsonRoyal)

Aviles_small Justin Bopp

Authors

Banny_small erik

Raysring1_small Tommy Rancel

Jinaz-reds-avatar_small JinAZ

Jmlogo_small Jack Moore

1753738656_110919ebe9_o_small vivaelpujols

1_small Graham

Baseball_small Mike Rogers

Redcap_small SFiercex4

Small Patrick Clark

Walter_album_small Walter Fulbright