A summary of what the findings were during a research session.
What is a report?
Aim, Study design & Methods, Executive summary & Severity, Description of findings, Next Steps.
What are the 5 common sections in a user research report?
Under different levels of severity.
How should the research findings be listed in the report?
Short-form note.
What is the basic and most frequently used form of communication for research findings?
Fast and easy to read, lacks details, often color-coded.
How does the spreadsheet-based report look & consist of?
In a clear and concise manner, reducing the chances of misinterpretation and to be usable by the development team.
How should a report be done?
The questions the development team wants to answer.
What does the Aim of user research refer to?
Gives the dev team a quick overview of the user test results and helps them prioritize decisions
Why is having a severity rating for the findings important?
Basic information, what happened during the testing session, a high-level report of what went well and what went poorly.
What information does the short-form note consist of?
It’s missing in-depth details on different issues and could get misinterpreted
What is a downside of using a spreadsheet-based report?
Show where improvements could be made & motivate the team to act on the result, modifying their build to increase the quality of their product.
What should a report do?
Adds credibility to the findings, readers will also better understand the process.
Why is justifying the study design and methods before discussing the findings important?
The issue’s location, frequency of occurrence and impact on the gameplay.
What are factors that could determine an issue’s severity?
In-depth explanation & analysis of the user test session and a large density of information.
What information does the comprehensive report consist of?
They have a visual reporting style & graphs that show how a player experienced the game or levels tested.
How does the experience graph report look & consist of?
The devs may fail to act and miss critical improvements that would impact the project’s success and make unnecessary changes.
What happens if the findings are not communicated to the development team effectively?
Participant profiles, the tested build or game version, and the analysis used for the results.
What elements may be included in the study design and methods section?
Description, reasoning why the issue occurred, gameplay video, quotes from the participant, questionnaire info.
What should be included in the list with issues, along with the issue itself?
Workshop-like meeting supported by slides and gameplay video.
What could help prevent the developers from just scanning over the large text information?
Visual elements, text descriptions, data collected during the test session, videos of a specific event, quotes from participants, interviews or ratings from questionnaires.
What information should the slides contain when using the presentation-based report?
By providing recommendations regarding future evaluation for the product
How should a research report often conclude?
To be more accessible and effective for the developers by using embedded plugins or tools.
What’s the customizable report purpose?
They visualise where players spent time and what was missed or skipped.
What do interactive customizable reports help visualize for developers?
Have a meeting or workshop where researchers discuss directly with the developers about the user testing findings.
What is the one thing researchers can do differently, compared to the other report methods, when using the presentation-based report?
Its customizability and interactivity show what has to change to optimise players’ experience.
What makes this type of report compelling for the development team?