Summary
The Ai Training Company is seeking experienced software engineers and technical task designers to support the training and evaluation of advanced AI coding agents. The role involves designing realistic full-stack engineering challenges, developing automated tests, and evolving applications involving APIs, databases, authentication, services, and infrastructure.
Responsibilities
- Design realistic software engineering tasks based on real-world product backlogs
- Create feature implementation tasks for full-stack applications
- Design backend and frontend engineering challenges
- Build tasks that evolve an existing codebase over multiple iterations
- Write deterministic automated tests that determine whether solutions are correct
- Create robust test coverage for expected functionality and edge cases
- Design tasks involving APIs, databases, authentication, services, and infrastructure
- Add new backend services when appropriate
- Design integrations across multiple programming languages
- Create gRPC-based workflows
- Build rate-limiting and service-control scenarios
- Introduce realistic debugging and maintenance challenges
- Review whether coding tasks accurately resemble professional engineering work
Skills
- Strong professional software engineering experience
- Hands-on experience with both backend and frontend development
- Strong TypeScript and JavaScript experience
- Experience building production web applications
- Experience designing and implementing APIs
- Experience debugging real systems
- Strong automated testing experience
- Good code-review instincts
- Ability to understand and modify existing codebases
- Strong written technical communication
- Comfortable working independently from written requirements
- Ability to create realistic software engineering tasks rather than artificial coding exercises
- • Experience with SQLite, PostgreSQL, or similar relational databases
- • Backend experience in Go, Rust, or Java
- • gRPC and Protocol Buffers experience
- • Distributed systems experience
- • Experience building microservices
- • Experience implementing rate limiting
- • API design experience
- • Experience working in large or long-lived codebases
- • Experience creating automated test suites
- • Experience building internal developer tools
- • Experience writing technical specifications
- • Experience reviewing other engineers' code
- • Experience designing coding assessments, benchmarks, or evaluation tasks
Qualifications
Must Haves
- Strong professional software engineering experience
- Hands-on experience with both backend and frontend development
- Strong TypeScript and JavaScript experience
- Experience building production web applications
- Experience designing and implementing APIs
- Experience debugging real systems
- Strong automated testing experience
- Good code-review instincts
- Ability to understand and modify existing codebases
- Strong written technical communication
- Comfortable working independently from written requirements
- Ability to create realistic software engineering tasks rather than artificial coding exercises
Nice to Haves
- • Experience with SQLite, PostgreSQL, or similar relational databases
- • Backend experience in Go, Rust, or Java
- • gRPC and Protocol Buffers experience
- • Distributed systems experience
- • Experience building microservices
- • Experience implementing rate limiting
- • API design experience
- • Experience working in large or long-lived codebases
- • Experience creating automated test suites
- • Experience building internal developer tools
- • Experience writing technical specifications
- • Experience reviewing other engineers' code
- • Experience designing coding assessments, benchmarks, or evaluation tasks