Rex.zone
Posted 176 days agoVerified live 1d ago
STEM Jobs in India
Brief overview
United StatesIn-person
UndergradOr in progress
STEM background or equivalent engineering experienceHigh attention to detailQA evaluationData labelingStructured review workflowsStrong documentation skillsRLHFLLM evaluationPrompt evaluationRanking tasksNERText classificationComputer vision annotationContent safety labelingPolicy categoriesAuditsInter-annotator agreement
About the company
Rex.zoneremoexperts.com
RemoExperts (by Abaka AI) is a global platform where skilled professionals and tutors contribute to AI training across video, image, audio, text, code, math, and more.
Job description
Summary
Rex.zone connects candidates to engineering and applied AI/ML workflows that power large language model training pipelines. The role involves supporting training data quality through various evaluation and labeling tasks in NLP and computer vision domains.
Responsibilities
- Execute data labeling for NLP and computer vision using clear taxonomies and instructions
- Perform RLHF-style preference ranking and rubric-based scoring for LLM outputs
- Run QA evaluation for completeness, consistency, and annotation guidelines compliance
- Conduct prompt evaluation and error categorization to surface model failure modes
- Perform named entity recognition (NER) and span labeling with strict boundary rules
- Support content safety labeling (e.g., harassment, self-harm, regulated goods)
- Maintain audit trails, adjudication notes, and participate in calibration sessions
- Communicate findings to stakeholders to drive measurable model performance improvement
Skills
- STEM background or equivalent engineering experience
- High attention to detail; ability to follow detailed specifications and handle edge cases
- Experience with QA evaluation, data labeling, or structured review workflows
- Strong documentation skills and consistency at scale in a metrics-driven environment
- Experience with RLHF, LLM evaluation, prompt evaluation, or ranking tasks
- Familiarity with NER, text classification, or computer vision annotation
- Exposure to content safety labeling and policy categories
- Experience improving training data quality via audits and inter-annotator agreement
Qualifications
Must Haves
- STEM background or equivalent engineering experience
- High attention to detail; ability to follow detailed specifications and handle edge cases
- Experience with QA evaluation, data labeling, or structured review workflows
- Strong documentation skills and consistency at scale in a metrics-driven environment
Nice to Haves
- Experience with RLHF, LLM evaluation, prompt evaluation, or ranking tasks
- Familiarity with NER, text classification, or computer vision annotation
- Exposure to content safety labeling and policy categories
- Experience improving training data quality via audits and inter-annotator agreement
More jobs like this
