Ambitus Research
Posted 24 days agoVerified live 1d ago
Paralegal - AI Evaluation
Brief overview
Remote
UndergradOr in progress
$40–$60/hrStated range
3+ yrsMinimum
Legal Document AnalysisContract AnalysisCourt Document AnalysisLegal Cite-Checking
Job description
Summary
Ambitus is an applied AI product and research company that partners with domain experts and enterprises to advance frontier AI capabilities. The Paralegal - AI Evaluation role involves analyzing legal documents, developing complex questions and grading criteria, and evaluating AI-generated answers for accuracy and legal relevance.
Responsibilities
- Read court opinions, filings with exhibits, and commercial contracts, and work out the questions a paralegal would face, such as tracing a contract's defined terms and cross-references to what a party actually owes
- Write challenging questions that can only be answered by combining information from several parts of a document, along with the correct answer and a checklist for grading responses
- Review answers written by AI models and other experts, flag anything that is wrong, missing, or unsupported by the document, and write clear feedback on how it should change
- Judge whether each task reflects how these documents are used in real legal work, keeping your judgments consistent across reviews
Skills
- • Paralegal certificate or bachelor's degree
- • At least 3 years of experience as a paralegal in litigation, corporate, or contracts work
- • Be experienced reading contracts and court documents closely, including definitions, cross-references, exhibits, and schedules
- • Have exceptional attention to detail and be comfortable applying the same standard across reviews
- • Possess English communication skills, with a focus on written proficiency
- • An ABA-approved paralegal certificate, a JD, or cite-checking experience is a plus but not required
Qualifications
Must Haves
- • Paralegal certificate or bachelor's degree
- • At least 3 years of experience as a paralegal in litigation, corporate, or contracts work
- • Be experienced reading contracts and court documents closely, including definitions, cross-references, exhibits, and schedules
- • Have exceptional attention to detail and be comfortable applying the same standard across reviews
- • Possess English communication skills, with a focus on written proficiency
Nice to Haves
- • An ABA-approved paralegal certificate, a JD, or cite-checking experience is a plus but not required
