What is quality score?

A quality score is a running grade of your work on an AI training platform. It is usually built from your accuracy on gold tasks, reviewer decisions on your submissions, and sometimes agreement with other annotators.

What it controls

• Which projects you are offered, and whether you stay on them.
• On some platforms, your pay tier or bonus eligibility.
• Whether you are invited to reviewer or specialist roles.

A score that falls below a project's threshold can lead to a pause, a retraining step or removal from that project, usually without affecting your account as a whole.

How to keep it high

• Read the guidelines fully and reread them after updates.
• Favour accuracy over speed, especially early on a new project.
• Read reviewer feedback and apply it to the next task.
• Dispute gold answers that are genuinely wrong, with a clear reason.

Example

A trainer's score drops from 92 to 81 percent in a week. The feedback shows the misses are all on one rule that changed in a guideline update. After rereading the update, the score recovers within a few days.