A technology company connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based. We are building competitive-programming problems and their automatic graders (test cases + checkers) used to train advanced AI coding models. You'll create problems, write both correct and deliberately-wrong solutions, and design the tough test cases that catch subtly-broken code.
Your work is what makes the training signal trustworthy.
What you will do.
- Write original algorithmic problems — clear statement, sound constraints, an intended solution
- Write correct solutions in C++ and Python
- Write realistic wrong solutions (common mistakes) to test against
- Build and harden test cases: generators, edge cases, stress and "hacking" tests
- Write checkers/interactors (testlib) for problems with more than one valid answer
- Confirm the quality bar: correct solutions pass, wrong ones fail, within time limits
What they ask
- Strong competitive programming background, shown by a public profile — a Codeforces rating OR an IOI / ICPC / national-olympiad record
- Fluent contest C++ (STL, complexity); comfortable writing Python
- Can explain why a solution is wrong and build an input that breaks it
- Strong written English (C1+)
Profile
- Associate — 1700–2100 (Expert / Candidate Master): easier problems
- Expert — 2200–2600 (Master / Grandmaster): harder problems
- Senior / Reviewer — 2600+ (Int'l Grandmaster) or IOI/ICPC medalist: hardest problems + quality review
Nice to have.
- IOI / ICPC alumni and top competitive programmers especially encouraged to apply
- Experience setting or testing problems for real contests (Codeforces rounds, ICPC, national olympiads, online judges)
- Testlib experience (checkers, validators, generators)
- Experience creating data for LLM code benchmarks or similar RL / evaluation datasets
Practical
- Participation is project-based.
- Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted.
- Paid per accepted task. Your rate depends on the qualification tier you reach and how efficiently you complete tasks — up to the equivalent of $90/hr.
How to apply
View the full assignment text and application details once your tailored application is ready.
Order a tailored application to view the full assignment and application details.
More context, less searching.
You get enough context to judge whether this job is relevant. The full brief, client details and next steps stay available inside the app.