Report: 'Bad design' is the No.1 complaint of Steam user review authors

Report: 'Bad design' is the No.1 complaint of Steam user review authors

A recent study of Steam user reviews shows that bad design is the No.1 annoyance for their authors.

That's according to a study from the Empirical Software Engineering journal - as reported by GamaSutra - which examined reviews for 6,224 games on Steam. In total 34 per cent of reviews made reference to bad game design, while eight per cent mentioned bugs.

57 per cent of negative reviews mentioned game design, with 17 per cent mentioning bugs. A smaller 29 per cent of positive reviews referenced bad game design, while just seven mentioned bugs, showing that a game featuring bugs do not necessarily lead to negative reviews.

The study doesn't define what 'bad game design' means, but it does seem to be a broad term for reviews that mention problems with the gameplay.

Despite this, negative reviews actually contain more valuable feedback than positive ones. 71 per cent of positive reviews are not helpful, compared to just 55 per cent of negative reviews.

Additionally, reviews on Early Access games are longer than non-Early Access titles. This is likely due to consumers being invested in projects that are not complete and wanting to provide more detailed feedback to what needs changing. In addition, reviews have a median "readability level" that stands at grade 8. In the American school system, that's between 13 and 14 years old. A median of 36 per cent of reviews have non-English authors.

Gamers also play a median a 13.5 hours before posting a review, with negative reviews being posted after less play time. Positive reviews are left after a median of 15.5 hours, while negative reviews are left after 6.6 hours.

You can read the full study here.

Valve has been making a number of changes to Steam user reviews in the last year. The PC giant added graphs so that users can see how reviews have tracked over time; this is one way of combating review bombing, where people intentionally leave negative reviews on games but is also a means of tracking how a game has improved over time. 

Since then, Valve has changed the ratio of positive to negative reviews that appear alongside a game

Editor - PC Games Insider

Alex Calvin launched in August 2017 and has been its editor since. Prior to this, he was deputy editor at UK based games trade paper MCV and content editor for marketing and events for London Games Festival 2017. His work has also appeared in Eurogamer, The Observer, Kotaku UK, Esquire UK and Develop.


No comments
View options
  • Order by latest to oldest
  • Order by oldest to latest
  • Show all replies
Important information

This site uses cookies to store information on your computer. By continuing to use our site, you consent to Steel Media's privacy policy.

Steel Media websites use two types of cookie: (1) those that enable the site to function and perform as required; and (2) analytical cookies which anonymously track visitors only while using the site. If you are not happy with this use of these cookies please review our Privacy Policy to learn how they can be disabled. By disabling cookies some features of the site will not work.