Reality Check
Tools of the Trade
Tenets and Traps
Feature QA Playbook
We’ve got issues
100

This was Meta’s (then Facebook’s) first PC-tethered VR headset, released to consumers in 2016.

What is the Oculus Rift?

100

This tool is used by Meta's QA team to create detailed bug reports efficiently

What is BugMaker?


100

Name that trap! 

This trap is when something in the UI suddenly appears or otherwise draws the user’s attention, distracting them from their goal.

What is Distraction?

100

This describes a feature in the Metallurgy model that gets coverage by automation and dogfooding only (no manual testing). Engineering can also decide to execute their own manual testing for their areas.

What is Silver Feature?

100

A bug that is associated with a feature that is not yet fully released to the public. This type of bug is typically identified during the development or testing phase.

What is a New Feature bug?

200

Although standalone, the Quest line supports this feature to connect to a PC and run high-fidelity VR experiences.

What is Oculus Link (or Quest Link)?

200

This AI-powered tool generates test strategies from PRDs in minutes

What is TestMate?

200

Name that trap! 

This trap is when visual appearance of a cue (label, icon, affordance, or prompt) for a given action varies across the UI

What is Inconsistent Appearance?

200

This milestone marks the completion of all functionality intended for release

What is Feature Complete?

200

To be used when a known amount of time has been spent to resolve or alter unwanted behaviour listed in 'Observed Results'. This tag is directly tied to the presence of a diff.

What is Resolution-Fixed?

300

This VR system detects when users leave their safe zone and renders a visual barrier in the HMD, requiring precise spatial calibration to avoid false positives.

What is the Guardian system?

300

This is an internal tool used to track new features (and enhancements) for OS and APK releases.

What is VRLM? (VR Launch Manager)

300

This tenet describes when a UI is ________ when users perceive that they are doing things in a minimal number of steps. A critical part of this definition is the perception of fewer steps rather than the actual number of steps.

What Is Efficient?

300

Number of QA reported bugs which results with resolution vs total number of bugs closed with Resolution

What is Bug to Diff Ratio

300

Used to indicate the highest level of priority for tasks or issues that require emergency attention

What is a UBN? (Un-Break-Now)

400

This system allows VR content to run in limited tracking environments, relying on 3DOF-like behavior as a fallback.

What is Stationary Mode?


400

This tool built on top of iLlama and fine-tuned with Meta's internal data, leverages natural language processing to provide context-aware assistance, augmenting employee productivity through features like code generation, technical Q&A, and augmented search

What is Metamate?

400

Name that trap! 

There are many aesthetically pleasing applications, websites and programs. This is not one. This overly cluttered phone app has poor color choice, label justifications and layout issues.

What is Unattractive Appearance?

400

This describes the process to reduce open bugs before a major release. It involves prioritizing, addressing, and resolving bugs within a set timeframe.

What is a Bug Burndown?

400

An important service is exhibiting intermittent failures, is partially down or degraded, and affects numerous (~5%) customers.

What is a SEV2?

500

This capability lets VR apps understand and persist real-world room geometry across sessions and users.

What is spatial anchoring?


500

This plugin leverages AI to identify and merge duplicate bug tasks, enhancing efficiency in task management by reducing redundancy and streamlining bug triage processes.

What is the Bug Dedupe Plugin?

500

Name that Trap!
Placement of the Edit control is inconsistent from one iPhone app to another. Several other functions are similarly inconsistent. This lack of consistency impedes habituation.

What is Wandering Element?

500

This is a formal request for adding a feature to a release. It restricts which features are accepted into a release for stability purposes.

What is a DCR? (Design Change Request)

500

A set of 9 quality CATegories intended to help teams across VR

What is SUPERCAT-D?