consumer playtest in game design
Screenshot: gamestudies.org
John P. Davis, Keith Steury and Randy Pagulaya published a paper about a survey method for assessing perceptions of a game at gamestudies.org:
"We have described the playtest method, which is a way to collect information from consumers about how they perceive a game’s elements. The main goal in using this method is to give game designers quantitative evaluations from players about how they experience the game. The method combines surveys with gameplay in a controlled environment, and we have found it to be a valuable way to identify gameplay issues and gain insight into players’ perceptions.
One of the ways to use the playtest method described in this paper is to focus on the first hour of play or the initial experience, an interval we feel is critical to “get right” in the design of a game. Many players who do not like a game almost immediately will quit playing. But variations of the method can also elucidate specific issues in games, many of which take place after the first hour of play. For instance, players can be given a short tutorial, asked to play missions that occur later in the game, and then asked to rate their perceptions of those missions. Another example of a more interesting use of a playtest may be to compare different player control schemes on players’ perceptions of the game. Controls have a large influence on whether or not players enjoy a game, so playtest data can be invaluable to help designers choose the optimal scheme. Portions of games that are in development can be tested over time to evaluate whether changes to various aspects of the game have had a positive impact on consumers’ perceptions. We also use playtest data to help with game tuning. For example, consumer data can help when designers tweak the handling of a car in a racing game or the difficulty of AI enemies in a shooter. "