Uber AI Solutions
Verified live 6h ago
Freelance: AI Content Specialist
Brief overview
United StatesIn-person
UndergradOr in progress
$25–$40/hrStated range
Linguistic analysisSafety auditingSeverity assessmentSide-by-side evaluationWritten justification and technical explanationModel stress-testingRed TeamingMultimodal evaluationCritical thinking and analytical reasoningContent safety evaluationBias and toxicity detectionFactual accuracy verification
Job description
Summary
Uber AI Solutions is a marketplace connecting freelancers with generative AI researchers, seeking analytical thinkers and Junior Linguists for high-level evaluation of GenAI models. The role involves linguistic analysis, safety auditing, and model stress-testing to ensure AI systems are safe, accurate, and natural.
Responsibilities
- Linguistic Analysis: Reviewing prompt context and model responses to analyze the relationship between user intent and AI output
- Safety & Severity Auditing: Evaluating outputs for potential risks (toxicity, bias, misinformation) and categorizing the severity of violations according to strict safety rubrics
- Side-by-Side (SxS) Evaluation: Comparing multiple outputs and using editorial judgment to choose the highest quality response
- Written Justification: Writing short, structured, and technically sound explanations for your ratings based on linguistic and safety principles
- Model Stress-Testing: Identifying model gaps and performing "Red Teaming" to ensure logic and factual accuracy
- Multimodal Evaluation: Assessing AI responses across various formats, including text, audio, and images, to ensure cross-functional model accuracy
Skills
- Bachelor's degree (or currently pursuing one) in Linguistics, English, Journalism, Communications, or a related research-heavy field
- Exceptional writing skills with the ability to explain complex and nuanced reasoning
- A strong pulse on content safety and the ability to identify subtle biases or harmful model behaviors
- Native-level English proficiency is a must
Qualifications
Must Haves
- Bachelor's degree (or currently pursuing one) in Linguistics, English, Journalism, Communications, or a related research-heavy field
- Exceptional writing skills with the ability to explain complex and nuanced reasoning
- A strong pulse on content safety and the ability to identify subtle biases or harmful model behaviors
- Native-level English proficiency is a must
More jobs like this
