Experienced administrators design benchmark tasks for AI agents: realistic calendar, travel, expense and records scenarios with mock emails and receipts, the expert solution path, and a rubric of 35+ criteria. Five years of admin work in a mid-to-large organisation. Paid per accepted task, $20–40/hour band.
Remote AI training and data labeling jobs
Filter jobs
Location
- Worldwide151 jobs
- United States18 jobs
- United Kingdom3 jobs
- Canada3 jobs
- Indiano roles alongside your other filters
- Mexicono roles alongside your other filters
Language
- English166 jobs
- Germanno roles alongside your other filters
- Spanishno roles alongside your other filters
- French1 job
- Japanese3 jobs
- Portugueseno roles alongside your other filters
Field
- Languages & Linguisticsno roles alongside your other filters
- Audio & Voiceno roles alongside your other filters
- Engineering26 jobs
- Business & Finance18 jobs
- Software & IT24 jobs
- Health & Medicine44 jobs
- Law, Policy & Security38 jobs
- General & Data Collection1 job
- Science & Math19 jobs
- AI Safety & Evaluation2 jobs
- Video, Image & Design3 jobs
- Data, AI & ML7 jobs
- Writing & Education4 jobs
- Other fields5 jobs
Newest
169 open roles matching these filters · page 6 of 8
- $20 – $40 / HourWorldwide
Turn your favourite open repositories into reinforcement learning environments for frontier coding models: subtle bugs, non-trivial features or performance problems, each with a reproducible setup, robust verifiers and a reference solution. About 15 hours a week, paid per task on a $50–100/hour band.
$50 – $100 / HourWorldwideWrite original, research-frontier questions in your own discipline that current AI models cannot answer, with sourced and cited reference answers, then test and harden them. Open to any field. Paid per accepted task, $40–90/hour band, five openings, remote contractor.
$40 – $90 / HourWorldwideA full-time, salaried research role at micro1 designing benchmarks, rubrics, datasets and evaluation pipelines for frontier coding agents. Base salary $200,000–260,000 plus equity and benefits, remote, one opening. Three years in software engineering, ML or evaluation.
$200000 – $260000 / YearWorldwideClinicians whose main practice is young abuse survivors review AI mental-health guidance on abuse cases, build case scenarios, and write trauma-informed best-practice content so models respond safely to vulnerable youth. MD or PhD (psychology or social work) preferred. $100–200/hour, 8 openings, contractor, remote.
$100 – $200 / HourWorldwideA part-time fellowship for federal civil litigators: draft and evaluate motions, judge where AI-written advocacy falls short of persuasive, and build the grading criteria that measure it. Requires at least three documented federal motion wins. 50 openings, $150–300/hour, remote contractor.
$150 – $300 / HourWorldwideEngineers with problem-setting credentials (olympiad committees, licensure exam items, qualifying exams) write hard technical problems in aerodynamics, materials, CAD, circuit design or mechanical engineering, and grade AI answers to them. 47 openings, paid per accepted task, $60–110/hour band.
$60 – $110 / HourWorldwideSolve, audit or adjudicate research-level benchmark problems in quantum optics: cascaded optical parametric amplifiers, SU(1,1) interferometers, loss and two-mode squeezing, using Bogoliubov and covariance-matrix methods. Ten openings, contractor, $80–160/hour, fully remote.
$80 – $160 / HourWorldwideWrite and grade evaluation tasks built on real health authority requests and sponsor responses, judging whether a drafted answer would survive a regulator. Five years of clinical submissions experience is the stated bar. Thirty openings, contractor, $50–80/hour, remote.
$50 – $80 / HourWorldwideA full-time research engineering role at micro1 building RL environments, reward functions, verifiers, synthetic data pipelines and automated evaluation systems. Base salary $200,000–300,000 plus equity and benefits, remote, one opening. Deep reinforcement learning experience required.
$200000 – $300000 / YearWorldwideRedline contracts in simulated negotiations, grade AI responses to contract scenarios, and write the grading criteria. Despite the IP title, the stated bar is a US JD, active US bar admission and three years on technology transactions (MSAs, NDAs, DPAs). 100 openings, remote contractor work at $100–200/hour.
$100 – $200 / HourWorldwideBuild reinforcement learning environments that test whether an AI model can deploy, secure, scale and recover production cloud infrastructure: realistic scenarios, deterministic tests, golden solutions and deliberately broken variants. 20 hours a week, paid per accepted task, $50–100/hour band.
$50 – $100 / HourWorldwideBuild realistic biostatistics benchmark tasks (clinical trial analysis, regulatory review, observational studies) with real datasets and 35+ item grading rubrics. Paid per accepted task, quoted at $60–100/hour. MS or PhD plus four years in pharma, CRO, hospital or academic medicine. 50 openings.
$60 – $100 / HourWorldwideInventor modellers wanted for a FreeCAD project: build parametric parts and assemblies from briefs, keep edits parametric, audit models against GD&T and DFM criteria, and produce and read technical drawings. 4+ years for edit work, 10+ for complex creation. $30–100/hour, 29 openings.
$30 – $100 / HourWorldwideSolve and grade hard mechanical design problems (GD&T per ASME Y14.5, tolerance stack-ups, DFM, drawing release) and check AI answers for engineering correctness. Five years of production design ownership asked for; problem-authoring credentials strongly preferred. $60–130/hour, paid per accepted task, 25 openings.
$60 – $130 / HourWorldwideExperienced Fusion 360 CAM programmers create 3, 4 and 5-axis toolpaths, tune post-processors, and write instructional material on CAM best practice for AI training. Five years required. Remote contractor role, 10 openings, $80–120/hour.
$80 – $120 / HourWorldwideReview sample contracts, flag risky or problematic clauses, write short memos on the findings, and explain legal concepts in plain language to train an AI. A JD with active or lapsed US bar membership and four years of document-heavy practice is the stated profile. 50 openings, remote contractor, $80–180/hour.
$80 – $180 / HourWorldwideSolve, audit or adjudicate research-level problems in holography: AdS/CFT, on-shell gravitational actions, the Weyl-Fefferman-Graham gauge and tensor algebra of boundary curvature invariants for holographic Weyl anomalies in d ≤ 8. Ten openings, contractor, $80–160/hour, remote.
$80 – $160 / HourWorldwideBrokers, appraisers and property managers with 5–10+ years explain feasibility studies, valuations, leases and market trends in writing, and build realistic property management scenarios, to train AI. At least 10 hours a week. $40–65/hour, 10 openings; US, Canada and UK preferred, Europe and LATAM considered.
$40 – $65 / HourWorldwideWrite hard feature and bug-fix tasks for AI coding models, plus deterministic verifiers that accept any valid solution and reject the rest. About 15 flexible hours a week, paid per accepted task on a $30–100/hour band, 300 openings; security backgrounds are a plus.
$30 – $100 / HourWorldwideAudit outpatient professional fee coding, review other coders' work, and make calibrated calls on E/M leveling, modifier -25, time vs MDM and NCCI bundling, at about ten reviews a day, for AI training data. CPC required, CPMA preferred, ten years' coding or academic medical centre audit experience. Fifty openings, $30–40/hour.
$30 – $40 / HourWorldwideExperienced IT leaders plan and run a small technology initiative with an external vendor, SLAs and stakeholder reporting, generating realistic management scenarios to train AI. Contractor, remote, 50 openings, $70–130/hour. Six years leading multi-quarter tech initiatives is the bar.
$70 – $130 / HourWorldwideAnnotate biological datasets, write problem sets and case studies grounded in real medicinal chemistry, and check AI answers for scientific accuracy. Contractor, remote, 30 openings, $90–120/hour. A PhD, PharmD or MSc and drug-discovery experience are preferred.
$90 – $120 / HourWorldwideSolve advanced physics problems from your own specialism and write them up in LaTeX, verified with SymPy, Python and Jupyter, for AI training. Open worldwide across a dozen subfields, 10–15+ hours a week over an 8–10 week project. 14 openings, contractor, $100–200/hour.
$100 – $200 / HourWorldwide
Nothing that fits today?
New roles land most days. Get them on Telegram or Discord as they are added, or read how the platforms pay before you apply.