HR Generalist - AI Evaluation

Summary

Ambitus is an applied AI product and research company that partners with domain experts and enterprises to advance frontier AI capabilities. The HR Generalist - AI Evaluation will analyze HR documents, develop realistic HR questions and grading criteria, and evaluate AI-generated answers for accuracy, completeness, and relevance to real HR work.

Responsibilities

• Read employee handbooks, leave policies, benefits enrollment guides, and collective bargaining agreements, and work out the questions an HR generalist would face, such as applying leave eligibility rules and their exceptions to an employee's situation
• Write challenging questions that can only be answered by combining information from several parts of a document, along with the correct answer and a checklist for grading responses
• Review answers written by AI models and other experts, flag anything that is wrong, missing, or unsupported by the document, and write clear feedback on how it should change
• Judge whether each task reflects how these documents are used in real HR work, keeping your judgments consistent across reviews

Skills

• Bachelor's degree in any discipline
• At least 3 years of experience as an HR generalist, HR business partner, or benefits specialist
• Be experienced answering employee policy and benefits questions from the written documents, including leave rules, plan tiers, and premium tables
• Have exceptional attention to detail and be comfortable applying the same standard across reviews
• Possess English communication skills, with a focus on written proficiency
• A SHRM or HRCI certification, or benefits administration experience, is a plus but not required

Qualifications

Must Haves

• Bachelor's degree in any discipline
• At least 3 years of experience as an HR generalist, HR business partner, or benefits specialist
• Be experienced answering employee policy and benefits questions from the written documents, including leave rules, plan tiers, and premium tables
• Have exceptional attention to detail and be comfortable applying the same standard across reviews
• Possess English communication skills, with a focus on written proficiency

Nice to Haves

• A SHRM or HRCI certification, or benefits administration experience, is a plus but not required