OrangeXMS wrote:Should 5 mean average? According to who?
Me!
Well, and most gaming magazine review systems pre 1997
.
OrangeXMS wrote:...While on some level using the midpoint as average makes sense it is still an approach with its own issues. Average when compared to what? Only games within the same console generation? Only games from the last 10 years? Every game ever released? On a purely technical level games are getting more advanced all the time so even bad looking games by comparison with their contemporaries could be considered well above average historically. Then there is the issue that with every reviewed release the true average will shift. Should old games need constant rereview to readjust the curve? I would also argue that games aren't in a normal distribution anyway, and reviews are not exhaustive. There are a lot more really bad games than there are really good games, but conversely really good games are much more likely to get reviewed...
I'd suggest that a game is assessed in that particular moment in time. Yeah, games generally improve in technical terms over the years but, imho, you assess as at that time. What kind of standard is the game in comparison to other title releasing around that period? Is it better (7 or higher), worse (4 or lower) or about the same (5 or 6)? I don't feel that you need to look back over the last ten years or at every game ever released.... you just make a call in that moment.
OrangeXMS wrote:...There are plenty of different approaches to scoring a game. Aggregators like metacritic even take scores using different scales and "convert" them to a score out of 10, but is a 4 star review really the same as an 8/10, or a 3 star a 6/10? I don't think so. Even when the scale is the same the score can have different equally legitimate meanings...
It's definitely not perfect... but, yes, there has to be some sort of method for comparing and contrasting the various review systems. Maybe a 4-star isn't exactly the same as 8/10, but I'd suggest that it's
roughly equivalent.
Of course, I understand and support people to create whatever scoring systems they choose! I recall Ace magazine scoring games out of 1,000 (as if "just" 100 options wasn't enough!). Equally, if someone chooses to mark games out of 16 and says that 9 is "average"... more power to them. This doesn't stop a need for aligning different methods and coming to some sort of "average", though.
OrangeXMS wrote:...Even if it were a scale that made sense, wanting every reviewer to conform to the same scale is madness.
Hehe... I'm not really sure that I was attempting to force reviewers to obey or anything... I felt it was pretty tongue-in-cheek and just an observation that - personally - I prefer the old-school way of using a review scale. In my mind, "5" is "about average". If you don't feel that is the cases for your assessments... or you choose to use different methods... that's all cool!