Skip to content
Labeling Jobs

What is code review task?

Written 

Checking model-written code for bugs, security problems and style, then rating it or writing a corrected version.

A code review task asks you to check code written by an AI model for bugs, security problems, performance issues and style, then rate it or write a corrected version. These tasks train coding assistants and are among the most common roles for software engineers in AI training.

What the work looks like

You get a prompt, such as "Write a function that merges overlapping date ranges", and one or more model solutions. You run or read the code, test edge cases, rate each solution against a rubric, and explain every problem you find. Many projects then ask you to write the correct solution, with tests.

What reviewers look for

  • Correctness on edge cases: empty input, duplicates, very large values.
  • Security: injection, unsafe input handling, secrets in code.
  • Whether the code actually does what the prompt asked, not a simpler version of it.
  • Readability and idiomatic use of the language.

Example

A model's merge function passes the obvious test but fails when one range sits entirely inside another. The reviewer marks it incorrect, adds a failing test case and submits a fixed version. Open roles are under Software & IT.

Looking for this kind of work? Software & IT roles

More terms: task types

Full glossary

Ready to look at roles?

Every listing shows its pay and who it is open to.