STEM & Technical Specialist: Rubric Design

What you'll do

This role is about authoring, not just reviewing. You write difficult questions in your own technical field that test multi-step reasoning, try them on frontier models, and describe where answers go wrong. The core deliverable is the rubric: required concepts, reasoning steps, acceptable alternative approaches, critical errors and partial-credit rules. The ad also has you critique other experts' rubrics for ambiguity, redundancy and inaccuracy, and produce reference answers for RL and SFT workflows.

Who fits

• A Bachelor's or higher in mathematics, physics, chemistry, engineering, computer science, statistics or another technical discipline
• 3+ years of professional, academic, research or industry experience in a clearly defined specialty
• Strong rubric-writing ability: measurable criteria, alternatives, critical errors
• C1 English for precise technical writing
• Preferred: exam writing, grading or peer review, and prior AI evaluation or RLHF experience

What it pays

The ad lists up to $100 an hour and no minimum. That is the highest figure in this batch and well above the US-only Sociology (up to $65) and SQL (up to $70) QA lead listings. Payment method and timing are not set out in the listing; the SuperAnnotate company page covers the contracting setup.

Worth knowing

Good:

• Highest ceiling in the batch
• Authoring hard problems is closer to research than to routine annotation
• The rubric skills transfer to other evaluation work

Less good:

• United States only
• The ad publishes no hours or project length
• Pay is a ceiling; writing questions that beat frontier models is hard and may slow throughput

About this listing

Posted on SME Careers, the board where SuperAnnotate recruits subject matter experts, and read there on 27 October 2026. The board shows no posting date. Requirements and the pay ceiling are from the ad; the comparisons with sibling listings are ours. The hiring process (recorded AI interview, Deel contracting, paid bootcamp) is covered on the company page. See SuperAnnotate.