« This Day In Red Sox History: December 24, 1967 | Home | This Day In Baseball History: December 25th (Billy Martin Dies In Auto Accident) »

The Limitations Of Defensive Metrics: If Jacoby Ellsbury Is So Bad In CF, Why Was He Named Defensive Player Of The Year?

By Administrator | December 24, 2009

072409_EllsCatch

During the course of the last week-to-ten-days, Red Sox Nation has been deluged by a succession of articles detailing Jacoby Ellsbury’s defensive inadequacies in center field. In the aftermath of the team signing CF Mike Cameron and RHP John Lackey, there has been rampant speculation that the ballclub would ship Ellsbury and RHP Clay Buchholz to the San Diego Padres for first baseman Adrian Gonzalez.

The Sox appear to be laying the groundwork for the team to trade the highly-popular center fielder through the Boston media, which appears to be all-too-willing to serve as an extension of Sox Public Relations Department — sowing the seeds of Ellsbury’s defensive inadequacies.

So it was interesting to learn that baseball fans across the United States voted the young Oregonian as MLB’s “Defensive Player of the Year” in balloting that was conducted on MLB.com at the conclusion of the ‘09 season (the “This Year In Baseball” awards).

And so we again find ourselves at the crossroads of one of the great baseball debates — can baseball officals (as well as fans and pundits) adequately judge a ballplayer’s ability by statistical analysis only(sabremetrics) or by observation only, or does it have to be some combination of the two?

It is arguable that the greatest development in baseball over the course of the last three decades has been the proliferation and popularization of new statistical tools for analyzing performance.

The Society of American Baseball Research has been at the forefront of the effort since 1971, and a large number of other individuals have joined the effort in the ensuing years, most particularly during the last twenty years or so. The sabremetricians, as they are commonly referred to, are constantly tweaking their statistical measures to enhance their ability to analyze and project, and the statistics they have developed have had varying measures of accuracy and acceptance among the vox populi.

Most devotees of the statistical tools contend that they are the be-all and end-all of performance analysis, but there are some among us (myself included) who feel the statistical approach must be balanced by subjective observation,and that while quantitative analysis is a significant piece of the assessment effort, the numbers alone don’t - and can’t - tell the whole story.

And that brings us to the defensive metrics that have been developed by the sabremetricians… tools that are admittedly flawed and unreliable. These stats are typically based on a subjective observation that provides an objective numerical assignment to a play in the field. In my opinion, they are almost doomed to failure because it is impossible to perfectly standardize a human observation… thus, based on the character of the tool, the metric is inherently imperfect.

The most popular (and most widely analyzed/criticized) of these defensive metrics is UZR (Ultimate Zone Rating). It proposes to determine the number of runs above or below the major league average a fielder is with respect to runs allowed/prevented: defensive range, strength of arm, ability to turn a double play and errors combined. The metric was developed by fangraphs.com.

While baseball fans voted Ellsbury the Defensive Player of the Year, the UZR metric instructs us he was the WORST defensive center fielder in the major leagues last season. These determinations are polar opposites — subjectively he is the best, objectively he is the worst.

So the question must be asked: in order for the metric to have some credibility - and to gain a even a small measure of acceptance - doesn’t the statistic have to present at least a nominal relationship to what we are able to observe?

The problem with the defensive metrics is that not only are they inherently flawed by design (the use of the subjective observation), but they often fly in the face of what our subjective observations tell us. It is a conundrum.

An additional problem with these metrics is that they are almost always based on “league average” and can therefore fluctuate dramatically from year to year based on whether better defenders get injured, or get traded, or sign with a team in another league. Their absence from the statistical pool can lower the league-average benchmark… and therefore a player can go from being “league average” to “better than league average” without ever having improved as a defender.

Again, if you accept the premise that Ellsbury is what he is on defense, you have trouble accepting that his UZR was +3 (3 runs above average) in 2008 and -18.6 (18.6 runs below average) in 2009.

The average baseball fan will NEVER understand how the statistic can vary so wildly - in fact, neither can many sabremetricians. And that underscores a second reason the metrics are not useful — they do not provide a consistent measure for a skill set that is, essentially, consistent.

(NOTE: for what is is worth, Mike Cameron’s UZR in 2009 was +10.0)

————————————

A final note on the problem with defensive metrics:

As I said previously, the defensive ability of baseball players is pretty much a constant - and most sabremetricians will agree with this premise.

In discussions about Yankees shortstop Derek Jeter, fans and pundits alike have widely debated his skill sets as a defender. Most Yankees fans swear by him, while most fans of other teams find him to be below average defensively (some of us believe him to be WELL below average defensively).

UZR shows him to be an average defender, or even a little above average.

Herein lies the problem with UZR and other similar metrics — a problem that will need to be addressed, explained and corrected by the sabremetricians before a metric such as it can ever gain acceptance: if Jeter is Jeter in the field, as assumed, then why did his UZR fluctuated wildly based on the defensive positioning of second baseman Robinson Cano? What does THAT have to do with JETER’S defensive skill set?

It is inarguable that Cano’s position has something to do with the overall infield defense, but it is also inarguable that it has NOTHING to do with the inate ability of Jeter in the field.

Topics: MLB Annual Awards, Sox Players |

3 Responses to “The Limitations Of Defensive Metrics: If Jacoby Ellsbury Is So Bad In CF, Why Was He Named Defensive Player Of The Year?”

  1. Chris Says:
    December 24th, 2009 at 9:38 pm

    Hey Sox1Fan!

    Merry Christmas!

    Wow! What an analysis! If you recall, before the start of the season, I thought that Jacoby would be the Sox MVP! Hard to believe that he is now the goat! Sad to say, but the Boston media runs the stories to accomplish and/or substantiate the Sox agenda; regardless of truth or substance.

    I guess we can just kiss him goodbye. The sad thing is, this is what the Sox did to Hanley Ramirez when they traded him for Beckett and Lowell. Not to downplay that Beckett has met all expectations and Lowell exceeded them, think back to what the Sox said about Hanley…young, undeveloped, an unproven rookie…
    What would the Sox give to have Hanley now!!

    Keep up the good work; keep the rookies off your page!

  2. anna Says:
    January 4th, 2010 at 7:21 pm

    i am in love with Jacoby Ellsbury, and i WILL marry him. <3 NUMBER ONE FAN RIGHT HERE BABY!!

  3. Baseball BIATCHES! - Page 2 Says:
    March 10th, 2010 at 9:05 pm

    [...] - UZR, for example, is still a little reliant on defensive formations. For example (taken from The Limitations Of Defensive Metrics: If Jacoby Ellsbury Is So Bad In CF, Why Was He Named Defensive…, an amazing article about the evolution of defensive metrics as it stands right now), Derek Jeter’s [...]

Comments

  • Photos

www.flickr.com

  • Our Friends








  • Sponsored Links


Online Slots


The top online casinos site is Jaxcasinos.com

There's quality sports betting sites at Sportsbetting3.com

NFL betting is safe and easy with Bet-on-the-NFL.com

We have cheap Red Sox tickets, Super Bowl tickets, UFC tickets and Mayweather v Pacquiao tickets

MyTicketIn.com is offering Houston Astros Tickets, Boston Red Sox Tickets, New York Yankees Tickets, Chicago Cubs Tickets, Philadelphia Phillies Tickets, at discounted prices.

  • Red Sox Charities









  • Red Sox Minor League Affiliates