Raydar
Software Engineer
$260K–$290K
San Francisco, California · Full-time · Posted Oct 1, 2026
- Experience
- 1 to 4 years of experience in software or machine learning engineering.
About the job
Designs datasets, evaluation methods, and measurement frameworks for training and assessing machine learning models, translating experiments and research goals into specifications for large-scale training.
What you'll do
- Design targeted data samples, scoring rubrics, and reward signals to identify weaknesses and support model training.
- Run experiments on annotator behavior and model capabilities; develop quantitative methods to assess dataset quality, diversity, and impact.
- Own training-data pipelines and translate research partners’ goals into data and evaluation specifications.
What they ask for
- Strong Python skills and experience building dependable data pipelines, experimentation tooling, or evaluation systems.
- Hands-on experience with language model evaluation, post-training, reward modeling, or related ML infrastructure.
- Sound scientific judgment, including designing controlled tests and drawing conclusions from imperfect results.
- Background building or auditing training data and assessing its support for model performance.
Pay
USD 260,000 to 290,000 per year (base salary)
Tools
Python
AI focus
Machine learning model training and assessment, including language model evaluation, post-training, reward modeling, and training-data design.
Model-written summary · the original posting is authoritative