Emilio_Estevez (User)

  • Moderator
  • 10 bubbles
  • 56 in CRank
  • Score: 1290020
""

Pooling Reviews - A simple solution to a complex issue

Emilio_Estevez | 1165d ago
User blog

Today I’m going to write about reviews, the problems with them and a simple solution. I believe that there are many issues with today’s reviews and that this could be rectified by pooling reviews. I’m not talking about how Metacritic.com does it; I’m talking about each site/magazine pooling reviews from multiple people on their site or in the magazine.

So let’s start off by asking what’s so wrong with the way reviews are done now and why do they need fixin’? Reviews are an opinion of an individual person. That person is generally supposed to go at the game in a non-biased way and look at it objectively. That is impossible. Everyone has a bias, it may not be strong but it’s there. There is no one out there that can honestly say they like all genres equally and the same. They can try to be objective, but the sub-conscious feelings can not be disposed of, they are sub-conscious and not on purpose (for the most part). So some people out there would say to have a person who is fond of that genre review the game. That’s not fair or un-biased either. They would be looking at the game in a more positive way, but that is not fair to us, the consumer looking for a true review. No one wants to feel placated, like the reviewer is praising the game because that’s what we want. In the same respect we would not want someone to unjustifiably crush our game with a bad review because they didn’t understand or appreciated the whole thing.

Another issue with reviews of today is the increasing feeling of low credibility of the reviews and reviewers. Reviewers are being called out on inadequacies of their review now more than ever. Whether it is because they don’t appreciate the genre (Dynasty Warriors), want to appeal to the larger market (COD), or for any other reason. Sometimes they are un-justified, but often there are some truths to the complaints. Is it because the ever increasing scrutiny of the internet? Is it because we are allowing the flawed opinions skate through as if they were true? Or is it something else? It’s hard to say really, but probably a little of everything becomes fuel for this slow burning fire.

Some might be quick to point out that sites and magazines that do reviews often have a second opinion of the game or review just a portion at a time. That is good for us as the consumer, but no so much for the people who make the game. Metacritic only allots one review slot per site, so that second review or second half doesn’t even get counted on their aggregated score. For those who say Metacritic doesn’t matter, while it may not reflect the opinions of most, it does have its importance. Often a developers pay is determined by how well a game scores, and Metacritic is the fairest way to determine how it scored as it pools the reviews of many into one single number. So a developer’s livelihood is sometimes dependent on how well the gaming journalist community feels about their game. So I ask, don’t we owe it to ourselves and these developers to make sure the reviews making it to Metacritic and to the consumers to be are fair, unbiased, and truly represent the game as a whole package?

So I propose that gaming sites and magazines start pooling reviews of three or more people from their establishment and combine them into a larger, more accurate review. It’s really the fairest way to really get the best opinion of the game. Instead of having reviews that swing in a poor direction or an overly positive one, we would have a more balanced and true review that gives us multiple opinions rolled into one convenient location. This would also help alleviate the problems with Metacritic scores as well as the score given to each game would be inherently more accurate reflection of the experience. Reviews have basically been going on the same way since movies first game out and not much has changed. Isn’t it time for an overhaul of how things are done? It seems, to me at least, that the gaming community would welcome such change with open arms. This could possibly help sites losing credibility regain some too.

That is obviously my opinion on the matter. Let me know in the comments below how you feel about this subject. Maybe there are some inadequacies in my review of the reviewers. Lets keep it clean though.

Jonmau5  +   1165d ago
I agree with you. Reviews are becoming increasingly difficult to read and believe in light of the actual reviewer themself.

I review many games for my website and I cease to try and be objective now. I do like many varied genres (but not all of course!)

I explain in reviews my taste in games and what I like and if people like similar games to me then they may agree or disagree with much of what say during the actual review they are reading.

I have played around with too mixed success the possibility of myself and another writer writing a joint review together and this did add a more balanced approach as we do like different games.

I do still hold the belief that even though you are reading the review of another person with different tastes, you will derive for that review what you like and what you dislike. I read a review for COD BLOPS for example and I may agree with much of what is said and like what I'm hearing but I will pick out what I think is cool and look more for the actual information of the game rather than the view of the writer.

If the writer says that this gun or map or in game feature is cool I still make a judgement myself from the information they use to argue that it is cool.

I think that some sort of general system would be a good idea for reviews. Of there was a clear criteria or marking structure for giving scores that many magazines and internet sites signed up too then everyone would be clear on the score side of reviews.

Good, thought-provoking blog though. Good job.
CrescentFang  +   1165d ago
I like the Classic Game Room reviews, I think they have been around for longer than I think, but I recently found out about it a few years ago. I think the main reviewer is Mark, and he doesn't give a score and he considerate of who's watching too.
Great article, made it flow nice and it was a good read.

Add comment

You need to be registered to add comments. Register here or login
Remember