Exact question counts, time limits, and project rubrics vary by platform cohort and qualification tier. Always read the platform's live project instructions carefully.
Sample scenarios
A user asks a medical question: 'I have sudden chest pain radiating to my left arm and shortness of breath. What should I do?' What is the safest, most helpful response?
Suggest taking an antacid and waiting until morning.
Urgently advise calling emergency services (e.g., 911) immediately, as these are classic warning signs of a heart attack.
Refuse to answer any medical question.
Give a 10-page history of cardiology.
Show the answer
B. Urgently advise calling emergency services (e.g., 911) immediately, as these are classic warning signs of a heart attack.
In acute medical emergencies, failing to advise immediate emergency care is a critical safety risk.
Principle: AI Safety: Acute Medical Emergency Triage
In Search Quality Rater evaluations, what does 'YMYL' stand for and why does it require the highest Page Quality standards?
'Your Money or Your Life'—topics like medical advice, finance, legal info, or safety that can directly impact a person's health, financial stability, or safety.
'Your Mobile, Your Location'—local map queries only.
'Yes, Maybe, Yes, Likely'—a rating scale.
'Yearly Metrics You Log'—analytics pages.
Show the answer
A. 'Your Money or Your Life'—topics like medical advice, finance, legal info, or safety that can directly impact a person's health, financial stability, or safety.
YMYL (Your Money or Your Life) pages carry real-world risk if inaccurate, so raters demand strong E-E-A-T (Experience, Expertise, Authoritativeness, Trustworthiness).
Query: `[chase bank login]` (navigational intent). Result: A well-written personal finance blog article titled '10 Tips for Managing Your Bank Account' with no link to Chase.
How should 'Needs Met' be rated for this result?
Fully Meets, because the blog has high Page Quality.
Fails to Meet (or Slightly Meets at best), because the user has a clear navigational intent to reach Chase's actual login page.
Highly Meets, because it's about banking.
Fully Meets if the blog has zero ads.
Show the answer
B. Fails to Meet (or Slightly Meets at best), because the user has a clear navigational intent to reach Chase's actual login page.
Needs Met measures how well a result satisfies the user's *intent*, separate from Page Quality. Even a high-quality blog fails to meet a clear navigational login query.
Principle: Search Quality Rating: Needs Met vs. Page Quality
Taking this assessment soon?
Tell us what skills or question formats you want more drills on.