SMG looks at nine top review sites: Who's the most biased?

Edge magazine's reviews show most 360 bias while IGN seems to prefer PS3 and Wii.

It's no surprise that game reviews can be contentious issues. Few fan bases are as passionate as gamers. Anytime you introduce opinion into the mix you're more than likely to have someone with the exact opposite view as you. Many gamers have cried foul on internet forums when they see their favorite titles receive less than stellar reviews or see games they personally don't care for achieve scores they feel the title is undeserving of. Often the review scores will simply be written off as "Oh, that's Gamespot. They don't like anything on the Console X."

SMG decided to test that idea to see if there was any credibility to it. We reviewed review sample scores from 9 well known publications to see if there was any evidence of a bias displayed.

The sites under the microscope were as follows: Edge, IGN, Gamespot, 1up, GameTrailers, Eurogamer, Gamepro, CheatCodeCentral and Gamespy.

Read Full Story >>
The story is too old to be commented.
JOLLY13128d ago (Edited 3128d ago )

They are really keeping an eye on gamespy, they are on the list twice. Well then, looks like a pretty good article, all in all. I like graphs.

*edit* It's weird that no one is bring up the IGN stat. I wonder why that is.

Anon19743128d ago

Fixed! Should have been Gamespy and Gamepro.

IcyJoker1873128d ago

Yup, that's why Gamespot and GT is one of my favorite sites to go to.

Edge gets a big thumbs down.

gaffyh3128d ago

I never trust Edge reviews, the stats (which I'm sure someone will post) show that they are clearly biased against the PS3 and lower the scores. Which means that they also inflate Xbox 360 scores, meaning all of their reviews are worthless imo.

SnuggleBandit3128d ago

The thing i don't like about IGN is it seems like they buy into the hype and rate all exclusives at least a nine...that and the fact that there brokken down scores don't always make sense when comparing other game(like gta 10/10 graphics and killzone 2 9.5/10 graphics.)

Shadow Flare3128d ago

This is brilliant article #2 that i've seen from this site. Well done darkride. And basically confirms what ps3 fans have been saying for ages. Sites like edge and eurogamer ARE biased. Its ridiculous. So expect them to give uncharted 2 8/10

IGN still hasn't fully won me back to them yet. If they give forza 3 a better mark then GT5 for graphics, it'll be pretty clear to me that they don't score games properly

HolyOrangeCows3128d ago

Gameinformer. I've never read a review from them that gave me the 'bias' vibes I get from Eurogamer, Edge, and IGN.

heroicjanitor3128d ago

So that means that you can average ign and edge to get the metacritic score(for the total games so far, but I doubt it works on a game by game basis, it would be cool if it did:)

presto7173128d ago

Ign cleans up after the xbox. Its a very bias site and is not to be taken seriously.

hulk_bash19873128d ago (Edited 3128d ago )

Im pretty sure that Eurogamer gave the game a perfect 10, so the only wild card so far is Edge. But, the way its been going so far maybe we might see a favorable review from them as well. Congratulations to ND they deserve it, and October 13 can't come any sooner.

Blaze9293128d ago

who cares. Thats why I like how alot of sites are doing this N/A score type thing now. This is becoming ridiculously stupid to where people aren't even reading/watching the review anymore, just skipping straight to the score for their childish fanboy antics.

Biased nothing. Like the article says, reviews are just a tool but more importantly, reviews are just one person's OPINION. Who cares if one site scores 360 games better than ps3 games or vise-versa?

With these no score type of reviews becoming more common now, itll bring back what reviews were originally for, OPINIONS and it will make people READ them again instead of skipping straight to the score.

Foliage3128d ago

Once you consider how the PS3 has dominated with the best exclusives, you need to consider again how these reviews are slanted in any instance the 360 comes any where close to the PS3. It's only the truth people, stop crying over it.

randomwiz3128d ago

I like the idea of not giving a score, but they should at least give a description like must buy, buy, rent, stay away, just to get a general idea

The number scores are based on different aspects, so each review is reviewed on a different basis, but they do help give an overall idea of how good the game is.

commodore643128d ago (Edited 3128d ago )


So what does this tell us?

- some review scores are slightly biased to ps3
- some review scores are slightly biased to wii
- some review scores are slightly biased to 360.

Really, there is no conclusive outcome, because different people review different games at different sites at different times.

The whole 'conspiracy against ps3' seems to be a vacuous fallacy.

Although, it must be said, for someone who works as a salesman in the finance industry, Darkride66's statistical method leaves a LOT to be desired.

Some of the methodological problems include:

- Inadequate sample size of review sites,
- Inadequate sample size of selections of games,
- Inadequate hypothesis testing of the results.

Would have been nice to see some correlation coefficients, and coefficients of determination (and interpretation) as pertaining to the scores of each review site. That would give a more meaningful result.

As it stands, it's a nice amateur journalistic article that shows us that really, across the industry, the interpretative bias is about even.
Of course, this is a generalisation, based on the flawed methodology used.

Take it with a (BIG) Pinch of salt, if you please.

starvinbull3128d ago (Edited 3128d ago )

One thing that hasn't been mentioned is that this guys stats assume that there isn't a general bias or downplaying that works against PS3 exclusives on many game-sites.

It's a shame Edge have got a bee in their bonnet this generation, till a short while ago they were the best read out there on the subject of video games.

Shepherd 2143128d ago

Its because GTA 4 is an open world game with so much going on that it couldnt possibly render Killzone 2 quality graphics. Killzone 2 has nothing but linear environemts to worry about, while GTA has much more ambiance, A.I. routines and orders, and sheer objects on screen interacting with each other. Not to mention the size of GTA 4 is much, much bigger than Killzone 2.

Syronicus3128d ago

Plain and simple. It has been the one ball int he Xbox fanboy court that they toss out every time a great new PS3 game hits store shelves. Now that their bias has been called out, I will remember to book mark this and shove it in their faces when they cry about a PS3 game that is getting rave reviews. Edge, you are a steaming pile of dog poo. Yeah, yo can quote me on that if you like.

prowiew3127d ago

i can bet that nobody here read exclusives reviews to decides if buying a game.

Shepherd 2143127d ago

Someone disagreed with me. This is not up for debate. This is not my opinion. This is fact. There is far more technology going on in GTA4 than Killzone 2. An entire world, teeming with thousands of civilians, cops, enemies, and friendly characters must interact with each other constantly and fluently. The world is much much bigger, which means many more polygons and textures to render. Then you have to worry about draw distances(how far you can see without objects popping up), which GTA4 has its hands much fuller than KZ2. The entire debate is mute. GTA4 has much more tech going on, its fact.

+ Show (16) more repliesLast reply 3127d ago
Simon_Brezhnev3128d ago

IGN is more forgiving for 360 exclusives

Anon19743128d ago

IGN scores averaged higher for all 3 consoles but they were actually harder on 360 exclusives then the PS3 and Wii. Have a look.

mastiffchild3128d ago

He means IGN are less harsh on 360 games than Edge are on PS3 exclusives and he's got a nit of a point, really, as Edge tend to stick the boot in further when they don't like something.

pansenbaer3128d ago

Well hopefully that puts to rest the "Edge is bias" theory.

FlipMode3128d ago

It didn't put it to rest, it proved it.

thedisagreefairy3128d ago

edge is obviousy biased and everyone knows it...i mean c'mon mgs4-8.0

and i always thought ign always showed love to the ps3 like when they gave resistance 2 a 9.5

i like ign though...edge on the other hand will never get a hit from me

JOLLY13128d ago (Edited 3128d ago )

miss disagree. Are you saying you like IGN because they are bias toward the ps3?

on a side note, are there such thing as male fairies? Well besides those kind.

thedisagreefairy3128d ago

thanks for the disagree though :)

i like ign because their reviews are always detailed and explain everything they like and dont like with valid reasons. seriously, ign has been THE game review site for over a decade because of how well their reviews are.

GameGambits3128d ago

I actually think Resistance 2 did earn itself about a 9.5....but that's just me. It's a FPS that does exactly what I want. It was the first FPS with alien guns that I actually liked too. It started a great trend with its form of co-op, had a spectacular ending to the single player, and has one of the best and lag free online there is.

It's really hard what you can nit pick against Resistance to mark it off, but if I had to pick something it's just the general pacing of the single player is off. It needs to be more action packed and in your face, but often it seems to be dragging you through it at a slow clip.

IGN for me doesn't show bias---it shows lack of well put together reviews. There's too many times they score the criteria for different games oddly to what they just stated in their review. Like someone mentioned Killzone 2 should have been at the time it came out perfect on the graphics department. Compared to any FPS out there on consoles it is THE best looking...10/10 for that. That's something about Killzone 2 that isn't up for debate, because you just have to look at it to know that is correct.

I go to IGN, Gametrailers, and Giantbomb for reviews. If those 3 give it a solid score than it helps push me in a direction on buying or renting something I was interested in. :)

+ Show (2) more repliesLast reply 3128d ago
fishd3128d ago

Edge is not biased.They are just a bunch of morons
Bryond Good & Evil 7?
Gow 7?

GTFO please

thedisagreefairy3128d ago (Edited 3128d ago )

colbert but how is this lame. this site actually just showed us the numbers...facts not opinions

and im watching ur show right now :)

Saaking3128d ago

he just doesn't like the truth. This is a very well written and interesting article.

talltony3128d ago

I dnt care what EDGE gives uncharted 2 because if its a good score they are just trying to win back ps3 fans trust and if its a bad score they are just showing their bias once again. I am done with edge either way cause I know where they stand.

3128d ago
Anon19743128d ago

360 fanboys don't even realize this is a pro-360 article, proving that not all websites (like Gametrailers, Gamespot, IGN) review's are all biased against the PS3.


+ Show (1) more replyLast reply 3128d ago