Software Engineer – Coding Benchmarks & RL Environments
Experience: Professional Software Engineering Experience Required
Job Type: Contractor
Location: Remote
Compensation: $45–$75/hour
Payment: Weekly Required Profiles: LinkedIn & GitHubRole Overview We are looking for Software Engineers to design realistic coding tasks used to train and evaluate frontier AI coding agents. The core application stack includes TypeScript, React, Node.js, SQLite, and Playwright, with opportunities to work across backend technologies such as Go, Rust, Java, gRPC, APIs, and system-level components.
Key Responsibilities:
Design realistic software engineering benchmark tasks based on real-world development scenarios.
Create tasks across full-stack web applications, backend services, APIs, and system integrations.
Write robust automated tests and validation logic for AI-generated solutions.
Build features and challenges using React, Node.js, TypeScript, SQLite, and Playwright.
Design backend-focused tasks involving Go, Rust, Java, gRPC, rate limiting, and services.
Use AI coding tools to assist with coding and testing where appropriate.
Work independently from written technical requirements and documentation.
Key Requirements:- Strong professional experience in Software Engineering.
- Hands-on experience across both frontend and backend development.
- Experience building and debugging production-quality systems.
- Strong understanding of automated testing and software quality.
- Experience with modern web technologies, preferably TypeScript, React, and Node.js.
- Availability for 10–20+ hours per week.
- Active LinkedIn and GitHub profiles are required.
- Preferred Technical Skills
- Frontend: React, TypeScript, JavaScriptBackend: Node.js, Go, Rust, Java
- Testing: Playwright, automated testing, integration testing
- Data: SQLite, SQL, databases
- Systems: REST APIs, gRPC, rate limiting, distributed services
Tools: Git, GitHub, AI coding tools
Selection Process1:Step 1 – Short Screener Step 2 – AI Interview Step 3 – Paid Work TrialStep 4 – Project Onboarding
