Summary
YO AI Labs is seeking experienced AI Software Engineering Domain Experts to contribute their technical expertise to an innovative project focused on improving next-generation AI systems. In this role, you will evaluate, review, and refine AI-generated software engineering content to enhance the quality, accuracy, and reasoning of AI models.
Responsibilities
- Analyze, review, and improve AI-generated software engineering content for technical accuracy and clarity
- Create, refine, and evaluate prompts to improve AI-generated technical outputs
- Conduct rubric-based evaluations of AI model responses, providing detailed quality feedback
- Draft and edit technical documentation, architecture documents, RFCs, design specifications, and engineering proposals
- Perform independent research and fact-checking to validate technical information
- Interpret and annotate technical data to support AI model training and evaluation
- Collaborate remotely with cross-functional teams to deliver high-quality project outcomes
Skills
- Critical Thinking
- Analytical Reasoning
- Quality Assurance
- Prompt Engineering
- AI Output Evaluation
- Technical Documentation
- Technical & Professional Writing
- Content Review & Editing
- Data Annotation
- Fact Checking
- Independent Research
- Business Communication
- Problem-Solving
- Attention to Detail
- 3+ years of professional experience as a Software Engineer, Senior Software Engineer, Staff Engineer, Technical Lead, Engineering Manager, Solutions Architect, or similar role
- Experience authoring or reviewing technical documentation, architecture documents, RFCs, design specifications, engineering proposals, postmortems, technical blogs, or code reviews
- Strong critical thinking, analytical reasoning, and structured problem-solving skills
- Excellent written communication and technical editing abilities
- Experience with AI coding tools or automated documentation tools is a plus but not required
- Advanced degree (Master's, MBA, JD, or PhD) or equivalent professional experience is preferred
Qualifications
Must Haves
- Critical Thinking
- Analytical Reasoning
- Quality Assurance
- Prompt Engineering
- AI Output Evaluation
- Technical Documentation
- Technical & Professional Writing
- Content Review & Editing
- Data Annotation
- Fact Checking
- Independent Research
- Business Communication
- Problem-Solving
- Attention to Detail
Nice to Haves
- 3+ years of professional experience as a Software Engineer, Senior Software Engineer, Staff Engineer, Technical Lead, Engineering Manager, Solutions Architect, or similar role
- Experience authoring or reviewing technical documentation, architecture documents, RFCs, design specifications, engineering proposals, postmortems, technical blogs, or code reviews
- Strong critical thinking, analytical reasoning, and structured problem-solving skills
- Excellent written communication and technical editing abilities
- Experience with AI coding tools or automated documentation tools is a plus but not required
- Advanced degree (Master's, MBA, JD, or PhD) or equivalent professional experience is preferred
Benefits
- Contractor (Part-Time)
- Location: Remote