Score AI-generated specs, release notes, user-facing copy and stakeholder updates, then write the rationale behind each score. The ad is unusually blunt that this is evaluation work only: no roadmap, no delivery, no sprint facilitation. Ten openings, contractor, remote, $90–140/hour.
Remote AI training and data labeling jobs
Filter jobs
Location
- Worldwide341 jobs
- United States37 jobs
- United Kingdom7 jobs
- Canada7 jobs
- Indiano roles alongside your other filters
- Mexico3 jobs
Language
Field
- Languages & Linguistics40 jobs
- Audio & Voice57 jobs
- Engineering69 jobs
- Business & Finance54 jobs
- Software & IT44 jobs
- Health & Medicine50 jobs
- Law, Policy & Security53 jobs
- General & Data Collection23 jobs
- Science & Math24 jobs
- AI Safety & Evaluation2 jobs
- Video, Image & Design35 jobs
- Data, AI & ML20 jobs
- Writing & Education13 jobs
- Other fields6 jobs
Newest
381 open roles matching these filters · page 16 of 16
- $90 – $140 / HourWorldwide
Score and compare AI-generated writing, then write the rationale that explains each judgement. micro1 calls the exercise a Write-like-Human Eval: you are the reader whose standards the model gets trained against. Ten openings, contractor, $90–140/hour, open to the US, Canada and the UK.
$90 – $140 / HourOpen to United States, Canada and 1 more countryRun simulated contract negotiations and redlining exercises, review how an AI handles the same scenarios, and write the grading rubrics that measure it. Three years of in-house technology-transactions experience is the stated bar. Task-based pay at roughly 3.5 hours per task.
$90 – $130 / HourWorldwideAssess adolescent eating disorder cases in writing, applying DSM-5, EDE-Q and SCOFF, judging medical stability against MEED, and saying whether FBT or CBT-E fits the clinical stage. Wants a licensed clinician with a recent adolescent caseload, and accepts paediatric medicine alongside psychiatry and psychology. Remote contractor work.
$45 – $95 / HourWorldwideSolve hard problems in your own scientific field, build the reference solution in Python, and judge whether an AI's answer is actually correct, catching the wrong assumption or missing constraint rather than just the wrong number. Seven fields qualify, and no specific degree or number of years is required. Global, roughly 15 hours a week.
$50 – $100 / HourWorldwideRefine CRM data models, arbitrate conflicting operational policies and document why you ruled the way you did, and design revenue workflows that hold up under vertical regulation. Four years with your hands actually in the system is the bar; the ad states outright that management-only exposure does not count. Remote contractor work.
$50 – $100 / HourWorldwideRedline commercial agreements (MSAs, NDAs, DPAs) against established playbooks, decide the company position and the acceptable fallbacks, and write the reasoning behind every markup. Asks for a JD, active US bar admission and four years of transactional practice. Remote contractor work on a project described only as confidential.
$90 – $110 / HourWorldwideAdvise on ab initio configuration interaction calculations of polarizability, critique atomic-structure work on Yb-171 and Yb-174, and explain sigma versus pi transitions, largely through spoken AI interviews, which on this listing are the work rather than the screening. Worldwide, 5 to 10 hours a week, and the ad asks only for what you can legally share.
$100 – $200 / HourWorldwideRun simulated contract negotiations and redlining exercises, judge how an AI handles contract scenarios, and build the grading frameworks that measure it. Three years in-house on technology transactions (MSAs, NDAs, DPAs) is the stated bar, and the ad spells out what task-based pay means: roughly 3.5 hours per task.
$100 – $130 / HourWorldwideReview and annotate data sets on children's learning and behaviour, judge model output for developmental and cultural accuracy, and write the guidelines that shape how an AI handles the linguistic, cognitive and psychosocial sides of child development. A PhD in the field is required; research or academic background counts, with or without clinical experience.
$100 – $200 / HourWorldwideReview case studies and simulated patient interactions for military and veteran populations, then write the expert feedback, prompts and scenarios that teach a model what good clinical practice looks like, including the cultural nuance this population expects. Asks for a completed psychiatry residency or a psychology PhD, plus direct patient care experience.
$100 – $200 / HourWorldwideReconstruct exact musical scores from mixed audio, separating soprano, alto, tenor and bass lines out of a mono recording and converting the whole performance into MusicXML, using Python to inspect the audio along the way. No degree and no set number of years are required, only demonstrable skill. Global, remote, roughly 15 hours a week.
$50 – $100 / HourWorldwideEvaluate AI-generated code for correctness and design, write hard coding problems with reference solutions and test cases, and review how a model reasons about architecture, debugging and system design. Asks for a year at a top technology company and a base in an English-speaking country. Remote contractor work at the top of this board's pay range.
$245 – $280 / HourWorldwideEvaluate how AI models reason through consulting-style business problems, write model answers and hard prompts, and give structured feedback on where the reasoning breaks down. Asks for at least a year at a top-tier consulting firm and a base in an English-speaking country. Remote contractor work at the top of this board's pay range.
$245 – $280 / HourWorldwideAssess adolescent substance use case material, stage severity against DSM-5 SUD and ASAM criteria, and recommend a level of care, separating developmentally normal experimentation from clinically significant patterns, and flagging withdrawal, overdose and safeguarding risks. Wants a licensed clinician with a recent adolescent caseload, not AI experience.
$45 – $95 / HourWorldwideRead adolescent case material and write structured suicide and self-harm risk assessments, applying C-SSRS and formal risk formulation, separating ideation from intent, and recommending escalation pathways and safety planning. The output trains models meant to guide non-specialists. Wants a licensed clinician with a recent adolescent caseload, not AI experience.
$45 – $95 / HourWorldwideBuild reinforcement learning environments that test whether an AI model can fix bugs, add features, refactor code and tune performance in real repositories, then write the golden reference solution it is graded against. Public open-source contributions are the requirement, not AI experience. Remote contractor work, roughly 15 hours a week.
$50 – $150 / HourWorldwideReview footage of robotic arms performing tasks and tag what happens against detailed grading guidelines, so robotics models learn from accurate labels. Remote contractor work paid by the hour; prior video annotation or training-data experience is strongly preferred.
$50 – $90 / HourWorldwideSolve advanced computational fluid dynamics problems (meshing, turbulence modelling, multiphase flow, heat transfer, solver setup), then judge whether AI-generated answers are engineering-sound and write up what is wrong when they are not. Three years of validated simulation work is the bar, not AI experience. Remote contractor engagement.
$50 – $150 / HourWorldwideBuild reinforcement learning environments that test whether an AI agent can fix bugs, implement features, refactor and optimise code while discovering and reasoning over information from real MCP servers. You design the reproducible environment, the deterministic verification and the golden reference solution. Remote contractor work, roughly 15 hours a week, hours of your choosing.
$60 – $120 / HourWorldwideReview and draft complex transactional documents (M&A, private equity and capital markets agreements) and give the structured commentary that teaches a model how a BigLaw associate reasons, including on data privacy and cross-border deals. Asks for a US JD, active bar admission and AmLaw 100 experience. Remote contractor work at the widest pay band on this board.
$140 – $400 / HourWorldwide
Nothing that fits today?
New roles land most days. Get them on Telegram or Discord as they are added, or read how the platforms pay before you apply.