Categories
challenge

Games UX Challenge – Research Methods

Move from ‘reading about’ to ‘doing’ Games UX and user research. This series of real-world Games User Research tasks will allow you to create portfolio-worthy examples of doing real games user research.

In this edition, we’re looking at how to pick the right research method.

Games UX Challenge - pick the right research method

Picking Research Methods

Research methods are the tools that researchers can call upon to answer the questions teams come to us with.

Some of the more common methods UX researchers use include:

  • Interviews
  • Observation of a live playtest (and asking live questions)
  • Observation of a pre-recorded playtest
  • A survey or questionnaire
  • A diary study

Researchers with specialist expertise might also apply:

  • Reviewing analytics from the game
  • A/B testing
  • Observation augmented with biometric readings or eyetracking

Picking the right method involves pragmatism. This requires not only understanding which method is best for collecting the data. Researchers frequently have to balance the ‘ideal’ method with considering which method or methods will get us an answer within the time, and budget we have available to us.

Scenario

The team behind Pokemon Unite have agreed some research objectives with you. They are:

  • Do players complete the tutorial?
  • Do players understand, and are they able to use their character’s special moves?
  • Do players learn how to score goals?
  • Do players enjoy the game?
  • Why do people stop playing within the first 30 days?

Now they want to know how to answer these objectives, and would like answers within the next 2 months.

The Task

If you haven’t played Pokemon Unite, you might want to download it and play through the first thirty minutes, to be familiar with the mechanics described above. (This is called screening the code)

For each of the research objectives, decide which method you would use to answer it. Then come up with an example of the question or task you might set players.

(a fictional example – if the objective was Do players understand what the shop does? , I might consider interviewing them about the shop at the end of a playtest and ask “Tell me how the shop works”)

Extra credit: Think about how you would explain + justify your method choices to someone who isn’t a user researcher and doesn’t understand which methods are good for which purpose.

Where to find help?

Here’s some reading around research methods:

This extract from the How To Be A Games User Researcher book introduces some common games user research methods.

This blog post from the Nielsen Norman group lists the differences and brief introductions to some research methods.

Tomer Sharon’s presentation on validating assumptions with research methods.

How do I enter?

The challenge is always open, so feel free to take part at any time – have a go at the task, and share it with me (or keep it as your own work!). I will be giving (friendly) feedback on many of the submissions received before 15th April 2022.

Follow me on twitter ( @Steve_Bromley) and tweet your research objectives with the hashtag #gamesUXchallenge and I will try and include it in my feedback round-up!

Categories
challenge

Games UX Challenge – Research Objectives

Move from ‘reading about’ to ‘doing’ Games UX and user research. This series of real-world Games User Research tasks will allow you to create portfolio-worthy examples of doing real games user research.

In this first edition, we look at setting research objectives.

Games UX Challenge 1 - Setting Research Objectives

Setting Research Objectives

Research objectives are an essential first part of designing a user research study. By agreeing with your team “what are we going to learn from this study”, we can make sure that we come back with reliable and relevant results.

Research objectives inform important decisions about recruiting participants, research methods, and what type of tasks and questions we’re going to set participants. Getting this right is very important for a successful study.

Scenario

The team behind Pokemon Unite have told you they see a big spike of players quitting in the first thirty minutes. They wonder if it’s because people are getting stuck and not learning everything they need from the tutorial. They have asked for a study looking at the tutorial to see if players are getting stuck or confused.

The Task

Download Pokemon Unite (on any platform. I think it’s currently on Switch, iOS or Android).

Play through the first 30 minutes. Work out what the game thinks it has taught players by the end of the first thirty minutes.

Write out a series of research objectives to cover each of the things that the game expects players to have learned from the first thirty minutes.

(a fictional example – if the game expected players to learn how to use the shop in the first thirty minutes, a corresponding research objective could be Do players successfully learn how to access the shop, and understand what the shop does? )

Extra credit: Think about extra reasons for ‘why might players be dropping out in the first thirty minutes’ beyond ‘not learning from the tutorial’ and write some additional objectives to cover those.

Where to find help?

Here’s some reading around research objectives:

This early newsletter edition + the linked extract from the book How To Be A Games User Researcher talks about setting research objectives.

Erika Hall’s excellent article on the difference between research objectives and interview questions

This article from UserTesting on setting research objectives.

Share your work

The challenge is always open, so feel free to take part at any time – have a go at the task, and share it with me (or keep it as your own work!).

Follow me on twitter ( @Steve_Bromley) and tweet your research objectives with the hashtag #gamesUXchallenge and I will try and include it in my feedback round-up!

For this first challenge, I’m also sending everyone who takes part by February 14th 2022 a free games user research sticker. DM me after you’ve done the task @Steve_Bromley and I’ll get that sent out*!

You Are Not Your Players Sticker
One of the free Games User Research Stickers!

* I’ll be trying to send one out to everyone who takes part, but if this isn’t possible based on where you live in the world we’ll work out an alternative together.