Skipping Jobs
True or False- Foreign Language is an automatic reason to skip a job.
FALSE! - Raters should make an effort to understand a post when there is foreign language present.
What is the first thing you should look for when you get a job?
You should identify any aspects of the two posts that are identical
What is the difference between a primary and a reasonable label?
Primary indicates that the two posts have an aspect that is identical.
What is the difference between the reasonable and somewhat reasonable label?
What should you do if you would like to report an issue in SRT?
Visit the Bug Report Playbook to learn how to report it
What should you do if you rate a job as "sensitive"?
Escalate the Job ID immediately to your manager
True or False - You should rate jobs based only on the visual elements.
FALSE! You need to consider the context of the posts. Some posts might contain the exact same person, exact same audio, or exact same topic but look nothing alike and they would still be rated as a primary match.
How would you rate a job where both posts are about an owner asking for advice on how to treat a skin rash on a dog?
Primary because there is an Identical Topic (and that topic is very specific).
How would you rate a job where two posts both contain a red dirt bike but in one post the owner is trying to sell the bike and in the other the owner is telling a story about his bike?
Somewhat Reasonable because they are not the same topic
If two videos are using the same sound, like a trending song, but are visually different how should they be rated?
Primary because they have Identical Audio.
What should you do if you see a job with posts that come back as private and/or no longer available due to deletion/removal by the user?
Make note of the Job ID and report it to your leadership
True or False- Two posts that are each showing a dog are a primary match.
FALSE! Unless you can identify that the dog in each post is the exact same dog, then this is not a primary match.
How would you rate two posts that contain the same actress but in one post she's playing a sport and in the other she's wearing a dress at a formal event posing with a group of people?
Primary because of an Identical Person
How would you rate a job where both posts are of a dog that the owner seems to be showing off? One post shows a puppy playing around. The other post shows a dog with a ribbon having just won a show competition.
Somewhat Reasonable because the posts are about different topics.
What is the big picture goal of this workflow?
To optimize the post suggestion (“Suggested for you”) feature on Facebook
What are the reasons to skip a job?
Foreign Language, query is sensitive, result is sensitive, one or both do not render
How do you know if your posts are showing an identical landmark?
It's easily recognized like the Statue of Liberty or the Golden Gate Bridge. Or the posts both clearly state in some way (the caption, tagging a location, in the content itself) that they are at the same location such as a specific named lake or a specific named mountain top.
How would you rate two posts where each shows characters from the same TV show but they aren't the same characters?
Reasonable
How would you rate a job where both posts are about an owner showing off their new motorcycle? The motorcycles don't look the same.
Reasonable because they have a similar topic, it doesn't matter that the motorcycles don't look the same.
Walk us through the steps you should take when rating a job.
First, collect context about each post by assessing what you can see, what the text says, and what locations, people, or dates are tagged. Second, identify which aspects of the posts are identical. Third, identify which aspects of the posts are similar. Fourth, identify which aspects of the posts are different. And last, select the best fitting label.
Name at least 8 of the 10 reasons to label a job as "sensitive"
1- Child Exploitation and/or Child Nudity, 2- Self Injury and Suicidal Content, 3- Credible Threats, Violence, or Calls to Violence, 4- Adult Sexual Content and/or Nudity, 5- Hate Speech, 6- Acts of Terrorism, 7- Human Trafficking, 8- Bullying and Harassment, 9- Unlawful Sale of Animals, 10- Violent, gruesome, or repulsive content, intended to shock users
What are the 7 categories for identical aspects you might see in two posts?
1- Identical Person, 2- Identical Animal, 3- Identical Landmark, 4- Identical Merchandise, 5- Identical Visible Element (usually naturally occurring like a rainbow), 6- Identical Topic, 7- Identical Audio
How would you rate a job where both posts contain a helicopter that looks the same. And both posts specifically state that it's a UH-1H Iroquois helicopter. But the helicopter is in different places with different backgrounds?
Primary because of an Identical Visual Element (the UH-1H Iroquois).
How would you rate two posts where one is of clouds in the sky and the other is of a building, but both posts clearly tag the same city?
Reasonable because both posts are focused on the same location.
Describe the Rater Decision Tree.
First ask: Are any aspects of these posts identical? If yes, then ask are these the same posts? Yes- vital, No- primary. If no, then ask are any aspects of these posts similar? If no, then there's no match. If yes, then ask is the topic between these posts the same? Yes- reasonable. No- somewhat reasonable