Reality Check
Tools of the Trade
Tenets and Traps
Feature QA Playbook
We’ve got issues
100
This was Meta’s (then Facebook’s) first PC-tethered VR headset, released to consumers in 2016.
What is the Oculus Rift?
100
This tool is used by Meta's QA team to create detailed bug reports efficiently
What is BugMaker?
100
Name that trap!
This trap is when something in the UI suddenly appears or otherwise draws the user’s attention, distracting them from their goal.
What is Distraction?
100
This describes a feature in the Metallurgy model that gets coverage by automation and dogfooding only (no manual testing). Engineering can also decide to execute their own manual testing for their areas.
What is Silver Feature?
100
A bug that is associated with a feature that is not yet fully released to the public. This type of bug is typically identified during the development or testing phase.
What is a New Feature bug?
200
Although standalone, the Quest line supports this feature to connect to a PC and run high-fidelity VR experiences.
What is Oculus Link (or Quest Link)?
200
This AI-powered tool generates test strategies from PRDs in minutes
What is TestMate?
200
Name that trap!
This trap is when visual appearance of a cue (label, icon, affordance, or prompt) for a given action varies across the UI
What is Inconsistent Appearance?
200
This milestone marks the completion of all functionality intended for release
What is Feature Complete?
200
To be used when a known amount of time has been spent to resolve or alter unwanted behaviour listed in 'Observed Results'. This tag is directly tied to the presence of a diff.
What is Resolution-Fixed?
300
This VR system detects when users leave their safe zone and renders a visual barrier in the HMD, requiring precise spatial calibration to avoid false positives.
What is the Guardian system?
300
This is an internal tool used to track new features (and enhancements) for OS and APK releases.
What is VRLM? (VR Launch Manager)
300
This tenet describes when a UI is ________ when users perceive that they are doing things in a minimal number of steps. A critical part of this definition is the perception of fewer steps rather than the actual number of steps.
What Is Efficient?
300
Number of QA reported bugs which results with resolution vs total number of bugs closed with Resolution
What is Bug to Diff Ratio
300
Used to indicate the highest level of priority for tasks or issues that require emergency attention
What is a UBN? (Un-Break-Now)
400
This system allows VR content to run in limited tracking environments, relying on 3DOF-like behavior as a fallback.
What is Stationary Mode?
400
This tool built on top of iLlama and fine-tuned with Meta's internal data, leverages natural language processing to provide context-aware assistance, augmenting employee productivity through features like code generation, technical Q&A, and augmented search
What is Metamate?
400
Name that trap!
There are many aesthetically pleasing applications, websites and programs. This is not one. This overly cluttered phone app has poor color choice, label justifications and layout issues.
What is Unattractive Appearance?
400
This describes the process to reduce open bugs before a major release. It involves prioritizing, addressing, and resolving bugs within a set timeframe.
What is a Bug Burndown?
400
An important service is exhibiting intermittent failures, is partially down or degraded, and affects numerous (~5%) customers.
What is a SEV2?
500
This capability lets VR apps understand and persist real-world room geometry across sessions and users.
What is spatial anchoring?
500
This plugin leverages AI to identify and merge duplicate bug tasks, enhancing efficiency in task management by reducing redundancy and streamlining bug triage processes.
What is the Bug Dedupe Plugin?
500
Name that Trap!
Placement of the Edit control is inconsistent from one iPhone app to another. Several other functions are similarly inconsistent. This lack of consistency impedes habituation.
What is Wandering Element?
500
This is a formal request for adding a feature to a release. It restricts which features are accepted into a release for stability purposes.
What is a DCR? (Design Change Request)
500
A set of 9 quality CATegories intended to help teams across VR
What is SUPERCAT-D?