What is rubric?
The written scoring guide for a task: what to check, how to score each point and what counts as a failure.
A rubric is the written scoring guide for a task. It says what to check, how to score each part, and what counts as an automatic failure. Every rating and evaluation project has one, and your work is judged by how closely you apply it.
What a rubric usually covers
- Accuracy: is every factual claim correct?
- Completeness: does the answer cover everything the prompt asked?
- Instruction following: length, format, tone and any constraints in the prompt.
- Safety: harmful, biased or private content.
- Style: clarity, no filler, consistent formatting.
Why it matters
Reviewers and gold tasks measure agreement with the rubric, not with your own view of a good answer. Reading it closely before starting, and rereading it when it is updated, is the single biggest factor in keeping a good quality score.
Example
A rubric says an answer with any factual error scores at most 2 out of 5 for accuracy, however good the rest is. A trainer who gives a polished but wrong answer a 4 will fail that gold task.
More terms: quality and review
Full glossaryReady to look at roles?
Every listing shows its pay and who it is open to.