QA / Software Engineering Reviewer: Browser Test Validation

What you'll do

AI coding benchmarks increasingly grade a generated web app by running browser tests against it. If a test is flaky or ambiguous, the benchmark scores the model on noise. This role is the quality gate: you review each browser test before it becomes part of a benchmark dataset.

Specifically, you check that:

• The browser interactions are technically feasible and reliable
• Isolation, fixtures, setup and execution order are sound
• Assertions produce a deterministic, unambiguous pass or fail
• There are no flaky timings, hidden dependencies or vague validation logic

Feedback is structured and follows the project's review rubric. You are reviewing tests, not writing the apps, and probably not writing many tests from scratch; the ad frames the job as review.

Who fits

• 3+ years in software engineering, QA, SDET or test automation
• Strong experience testing modern web applications
• Playwright, Cypress, Selenium or similar
• Hands-on experience writing automated UI and end-to-end tests
• A firm grasp of test isolation, fixtures and reproducibility
• Good debugging instincts and attention to detail

If you have spent time hunting down flaky Playwright tests in CI, you already know the failure modes this job is looking for.

What it pays

$30–60 per hour, paid weekly on Stripe or Wise. The band is wide, and the ad does not say what places you within it. It is also well below Mercor's senior software evaluation listings, which reflects a lower experience bar.

Worth knowing

Good:

• A clear, well-defined task with a rubric
• 3 years of QA experience is enough; no degree mentioned
• Remote, self-scheduled, weekly pay

Less good:

• The $30 floor is low for experienced SDETs
• No hours or duration stated
• Projects can be extended, shortened or ended early
• H-1B and STEM OPT holders are excluded
• Contractor terms, no benefits

About this listing

Posted by Mercor as a remote hourly contract, read on 24 September 2026. Mercor's original title uses a dash; we have replaced it with a colon. Pay, requirements and payment terms are the ad's own. See Mercor.