Engineering & Software Domain Expert
- Pay
- $65 – $105 / Hour
- Open to
United States
- Work mode
- Hybrid
- Apply
We earn a commission if you sign up through the links on this page. It costs you nothing and does not affect which jobs we list. How this works.
- Skills
- software engineering
- code review
- benchmark design
- technical writing
- distributed systems
- llm evaluation
What you'll do
This is the in-person counterpart to Mercor's remote software evaluation contracts. You sit with a leading AI lab's research and programme teams, on the lab's own tools and equipment, and define what "correct" looks like for engineering work.
Four strands:
- Data QA and review: catching missing behaviours, thin reasoning, code that runs but is subtly wrong, unhandled edge cases, and answers that would not survive a real code review
- Instruction specs and golden datasets: writing specs, golden solutions and new tasks that reflect how engineering is done in practice
- Benchmarks: designing hard evaluation sets and helping build engineering-specific skills and tools with the researchers
- Calibration: agreeing standards with researchers and adjacent specialists, making tacit judgment explicit
The lab wants a specialist. Named examples of acceptable specialisms: distributed systems and backend infrastructure, security and cryptography, embedded and firmware, ML systems, developer tooling and platform engineering, and quality and test engineering.
Who qualifies
- A bachelor's or higher in CS, software engineering or a close discipline; an MS or PhD is strongly preferred
- 4+ years building and shipping production software or engineered systems at a reputable organisation (internships and coursework do not count)
- Genuine specialisation in at least one area above
- Progression to Senior, Staff, Principal, Architect or Engineering Lead with real design ownership
- A visible record (shipped systems, patents, open source, publications) is preferred
- Hands-on professional use of LLMs and the judgment to spot a well-argued wrong answer
- 40 hours a week for an initial 6 months
- Living in the Bay Area, or willing to relocate at your own cost
Location and commitment
This is not remote. You must live in the Bay Area and work on-site with the client team multiple days a week when required. Relocation is at your own expense, with no assistance. Six months full-time is the initial term.
What it pays
$65–105 per hour, W-2 through Cincinnatus LLC, which handles payroll and benefits. The ad publishes no payment schedule. Note that at the bottom of the band, $65 an hour is low for a Staff-level Bay Area engineer; the top of the band is more realistic for the seniority asked for.
Worth knowing
Good:
- W-2 with benefits and a six-month initial term
- Direct, in-person work with frontier-lab researchers
- Broad range of specialisms accepted
Less good:
- Bay Area residence required; relocation unpaid
- The $40 band is wide and the placement criteria are not stated
- Full-time and exclusive of a regular job
- The lab is not named
About this listing
Posted on Mercor's platform, read on 24 September 2026. Employment, onboarding, payroll and benefits run through Cincinnatus LLC, separate from Mercor. Pay, location rules and qualifications are from the ad. See Mercor.
More roles at Mercor
See all 304Similar roles at other platforms
- Software Engineer (Coding Tasks, Testing Focus)micro1 · $30 – $100 / Hour · 7d ago
- Open Source GitHub Maintainermicro1 · $150 – $300 / Hour · 15d ago
- Senior Software Engineer: AI Evaluation & BenchmarksAlignerr · $80 – $100 / Hour · 1mo ago
- Technical Task AuditorInvisible Technologies · $60 / Hour · 28d ago
Guides about Mercor
See all 52- How much does Mercor pay? Rates from 304 live listingsPay breakdown
- The Mercor AI interview: what happens, what it checks, and what comes afterInterview prep
- Mercor vs Alignerr: which to apply to, and how they differPlatform comparison
- Mercor, micro1, Outlier, Alignerr and Handshake AI compared: which to apply to firstPlatform comparison
Browse similar roles
Not the right fit?
See every open role, or get new ones on Telegram or Discord as they are added.