Try our new beta!Click here
30°
Submitted by Lavalamp 1002d ago | opinion piece

Defining Success: Why Metacritic Should Be Irrelevant

Warren Spector tackles the thorny issue of Metacritic's impact on the industry in his second exclusive column for GamesIndustry International (Industry, Metacritic)

P_Bomb  +   1002d ago
Interesting read. One passage which echoes my sentiments:

[QUOTE]
Beyond questions of the utility of its data, there are two aspects of Metacritic's methods that undercut its credibility in my eyes and, should, I think call its accuracy and even the validity of its data into question.

First, the aggregation of data is skewed by the selection of review sites included in the aggregation. For example, with Disney Epic Mickey, I know of several perfect scores (higher even than I would have given the game!) that were simply not listed or included in the game's average. And we're talking about high profile, well-respected sites here. By way of contrast, our worst review scores, typically from Some Guy With a Website, were integrated in the aggregation instantly. I know this sounds like sour grapes and if you want to interpret this in that way, you're welcome to do so. But with future projects, team bonuses, and so on hanging in the balance, I don't think it's inappropriate to ask for a public discussion of the reasoning behind reviews that are included in Metacritic's calculations and those that are not.

Second, the data are skewed by the weighting and summary-conversion systems employed by the people behind Metacritic's ratings. Though I have no idea what criteria are applied or the decisions made, my understanding is that certain reviews are given greater weight in determining a game's overall score. I applaud the concept here, but without knowing exactly how the weighting is applied, the validity of the score is called into question.

Similarly, the widely discussed conversion of certain reviewers' letter grades into a numerical rating is arbitrary. And the conversion of 1-10 scales and 1-5 star ratings to Metacritic's 1-100 point scale introduces a host of problems. Is a B and 80? Who decides? Is a 3 star review a 60? Again, who says? And what are the ramifications of making that decision?
[/QUOTE]

This. Those aspects remain shrouded in wtf, yet make arguably the biggest difference. Metacritic's letter grade to number conversion is at odds with the way we're taught in school, and scores out of 5 getting converted to 100 definitely lose something in translation. The list goes on. Seems like a pretty haphazard thing to hang company bonuses on.
#1 (Edited 1002d ago ) | Agree(0) | Disagree(0) | Report | Reply

Add comment

You need to be registered to add comments. Register here or login
Remember
New stories
30°

Top Twitch Games In January 2016

21m ago - While we just love to play online games, there are many in the world that love to watch their fav... | PC
30°

NOOZh preview, a creepy dungeon crawler, storyteller platformer - TGG

22m ago - I had a feeling that I was in for a treat when I got offered to play the demo for Wannabe Studios... | PC
Ad

Gran Turismo SPORT Beta Testing Begins early 2016

Now - Start tracking GTS with Releases.com's release date alert service and be notified when the GTS beta launches. | Promoted post
30°

The 2016 Player 2 Video Game Fantasy Draft – Wildcard Round

25m ago - The final life saving choices are made for the Player 2 Fantasy Draft. Now the wait to see how th... | PC
30°

YIIK Will Be Cross-Buy and Cross-Save on PS4 & Vita

27m ago - "In a world where we see “cross buy” a lot less frequently than we were led to believe we would,... | PS4
40°

Cookie Clicker Upgrades to Make Sure You Don't Get Anything Done Again

28m ago - Twinfinite writes, "This deceptively sinister clicker game initially made its big debut back in 2... | PC