Legal & Compliance Specialist: Rubric Design

What you'll do

The centre of this job is rubric writing. You create difficult professional scenarios (contracts, privacy, financial regulation, employment, corporate compliance, depending on your specialty) and then turn expert judgment into structured criteria: which issues must be spotted, which standards apply, what exceptions and jurisdictional points matter, and what counts as a critical omission.

You also grade AI answers against such rubrics, critique rubrics written by other experts for missing issues, ambiguity and excess subjectivity, and produce reference answers and preference data for reinforcement learning and supervised fine-tuning. It is one of the few ads that asks you to separate legitimate alternative interpretations from objectively weak analysis.

Who fits

• JD, LLB, LLM, another law degree, compliance qualification or equivalent background in your specialty
• 3+ years in law, regulatory compliance, legal research, policy, risk, privacy or contracts
• English at C1 or above
• Expertise in a defined legal, regulatory or compliance domain
• Ability to design rubrics covering issues, standards, reasoning steps, exceptions and risks
• Comfort critiquing rubrics from peers

Nice to have

• Bar admission or professional qualification (strongly preferred for attorney-focused roles)
• Teaching, exam-writing, peer review, legal editing or supervisory review
• Prior AI evaluation, RLHF or benchmark experience

What it pays

The ad states up to $120 an hour, a ceiling. It ties with the Legal Quality Assurance Lead at the top of the legal listings in this batch; the Legal Expert tops out at $115 and the Legal Researcher at $110. The listing does not publish payment terms; the process and payout details are on the company page.

Worth knowing

Good:

• A $120 ceiling, among the highest in the batch
• Rubric design is a defined, skill-based niche
• Alternatives to a JD are accepted

Less good:

• US only
• Rubric writing is exacting and unlike billable legal work
• The ad does not say whether specialisations are matched to projects
• Monitored hourly pay

About this listing

Posted on SME Careers, where SuperAnnotate hires subject matter experts; we read the ad on 27 October 2026. The board gives no posting date. The listing is open to applicants in: US. The hiring sequence (recorded AI interview, Deel contract, paid bootcamp, time tracking) is covered on the company page rather than repeated here. See SuperAnnotate.