Outlier
Posted 137 days agoVerified live 1d ago
LLM Agent Engineer (Freelance, Remote)
Brief overview
Remote
2+ yrsMinimum
Backend engineeringAI automationComplex systems integrationModular software designPythonJavaScriptGoJavaSQL databasesMulti-turn system interactionsAPI integrationSupabaseGmail APIPersistent state managementSession discoveryFailure detectionPrivacy leak identification
About the company
Outlieroutlier.ai
Owned by Scale AI (invested in by Amazon and Meta), Outlier is the world's largest platform that connect real-world experts and grads with AI training projects in Law, Computer Science, Web Development, Math, Science, Languages, and more.
Job description
Summary
Outlier Ai is a company focused on enhancing AI agents through human feedback. They are seeking an LLM Agent Engineer to help train advanced generative systems that optimize complex workflows in collaboration with leading AI organizations.
Skills
- 2+ years of experience in backend engineering, AI automation, or complex systems integration
- Proven ability to build and maintain production-grade software with modular separation (e.g., distinct services for data parsing, logic processing, and reporting)
- Strong command of at least two major languages (e.g., Python, JavaScript, Go, or Java) and experience working with SQL databases
- Practical experience building for live, non-mocked environments and handling multi-turn system interactions
- Outstanding attention to detail and the ability to provide clear, high-density technical feedback on complex system behaviors
- Expertise building multi-stage coordination tasks where data acquisition leads to reasoned output
- Hands-on experience integrating agents with live tools such as Supabase, Gmail, and various APIs to solve real-world problems
- High level of comfort implementing persistent state and session discovery using MEMORY.md to track agent progress
- Experience identifying subtle failures like privacy leaks, authority escalation, or indirect prompt injections
Qualifications
Must Haves
- 2+ years of experience in backend engineering, AI automation, or complex systems integration
- Proven ability to build and maintain production-grade software with modular separation (e.g., distinct services for data parsing, logic processing, and reporting)
- Strong command of at least two major languages (e.g., Python, JavaScript, Go, or Java) and experience working with SQL databases
- Practical experience building for live, non-mocked environments and handling multi-turn system interactions
- Outstanding attention to detail and the ability to provide clear, high-density technical feedback on complex system behaviors
Nice to Haves
- Expertise building multi-stage coordination tasks where data acquisition leads to reasoned output
- Hands-on experience integrating agents with live tools such as Supabase, Gmail, and various APIs to solve real-world problems
- High level of comfort implementing persistent state and session discovery using MEMORY.md to track agent progress
- Experience identifying subtle failures like privacy leaks, authority escalation, or indirect prompt injections
More jobs like this
