Categorization 1
This acronym refers to the process of aligning the available supply of human reviewers with the demand for content moderation, data labeling, and other tasks. The goal is to ensure that the right people are working on the right tasks at the right time.
What is SDM?
This is an entry point vehicle that enforces and captures granular and trustworthy metadata that provides granular insights into how we use our review resources.
What is Demand API?
This metric is the mean of the amount of time it takes a reviewer to complete a job. It is typically measured in minutes or seconds and can be used to evaluate the efficiency of an individual or team.
What is Average or Active Handle Time, aka AHT?
Indirectly inspired by a popular fast food menu item, this Integrity system automates prioritization of Content Moderation jobs that are candidates for human review.
What is Big Mac?
In Global Operations, this term refers to a need that exists in our scaled Meta economy for a specific good or service often driven by explicit consumer needs or organically.
What is demand?
In the context of human review and content moderation, a ______ refers to the overall process of reviewing and actioning content. It encompasses all of the steps involved in the review process, including job assignment, decision-making, and quality assurance.
What is a workflow?
_____ = Actual community standard/ad policy violations that are correctly identified by reviewers.
What are True Positives?
An optimization lever that leads to deprecation of scaled support of a specific language and/or with specific cultural context for a workflow because such specialized-support it is no longer necessary due to a change in regional context, improvements in translations and tooling, needs to drive OPEX savings, etc.
What is de-marketization?
In Global Operations, this term refers to the amount of reviewers or reviewers hours we have at various staffing sites.
What is supply or capacity?
These are specific collections of jobs that share common characteristics and are assigned to a group of reviewers for processing. They are used to manage the flow of jobs through the review process, and can be configured with different settings such as target turnaround time (TAT), escalation rules, and quality assurance parameters.
What are queues?
_____ = Actual community standard/ad policy violations that are not correctly identified by the reviewer.
What are False Positives?
Externalization is the term used to describe shifting scaled review workforces from ___ to ____.
What are CONTRACTORS to OUTSOURCE VENDORS?
This is the general workforce that provides manual validation for data and cases that support a range of operations such as appeals, enforcement, and labeling.
What are human reviewers?
_____ is the standard measure used to quantify scaled review demand.
What is weekly workload hours?
_____ = True Positive / (True Positive + False Positive). In other words, this metric is the proportion of correct decisions made by reviewers out of all decisions made. It is a measure of the accuracy of the review process, and is calculated as the number of true positives (correctly identified violations) divided by the total number of decisions made.
What is Precision?
This tool, which is used by Integrity Ops and soon by PDO, is used to facilitate requests for Scaled Ops teams to make changes to their scaled review resources, workflows, queues, policies, etc.
What is Human Review Planner (HRP)?
Acronym used to symbolize operational expenses, and typically used in Global Ops to refer to scaled review budget.
What is OpEx?
Economists attribute the theory of supply and demand to this philosopher.
Who is Adam Smith?
_____ = True Positive / (True positive + False Negative). In other words, this metric is a ratio of refers to the proportion of actual violations that are correctly identified by reviewers out of all violations present in the sample.
What is Recall?
Related in spirit only to supply and demand, what is the name of Sam's dog?
What is Shoshana?