Trata (YC W25)
Posted 145 days agoVerified live 1d ago
Research Scientist Intern
Brief overview
San Francisco, CAIn-person
$10k–$17k/yrStated range
About the company
Trata (YC W25)trytrata.com
Trata gives hedge funds un-biased, unfiltered stock analysis from anonymous Analysts at well-known funds.
Job description
Summary
Trata is a company that builds proprietary training environments and evaluation infrastructure used by frontier AI labs. They are seeking a Research Scientist Intern to design datasets and evaluation rubrics that influence how frontier models learn, with opportunities to co-write a significant paper and contribute to model training runs.
Responsibilities
- Design data slices that expose meaningful model failure modes
- Build and refine evaluation rubrics and reward signals for RLHF and RLVR training pipelines
- Develop quantitative frameworks for measuring dataset quality, diversity, and downstream impact on alignment and capability
- Partner with lab research teams to translate training objectives into concrete data and evaluation specifications
Skills
- Deep curiosity and motivation around how data structure, selection, and quality drive model behavior
- Ability to design lightweight experiments, move fast, and extract actionable insights from messy results
- A bias toward building over theorizing
- Prior experience at an AI safety org, benchmarking org, or RL environment company is a strong plus
Qualifications
Must Haves
- Deep curiosity and motivation around how data structure, selection, and quality drive model behavior
- Ability to design lightweight experiments, move fast, and extract actionable insights from messy results
- A bias toward building over theorizing
Nice to Haves
- Prior experience at an AI safety org, benchmarking org, or RL environment company is a strong plus
Benefits
- We pay for travel
More jobs like this
