Senior / Staff Software Engineer — AI / ML

What you'll do

• Optimize agent evaluations through methods such as adaptive sampling, early stopping, model cascades, and caching.
• Build model routing, fine-tuned model serving, task-difficulty prediction, and rigorous AI data measurement systems.
• Turn research prototypes into reusable production components and shape the ML & Research Engineering discipline.

What they ask for

• 5+ years building production ML or software systems, with end-to-end ownership from prototype to production.
• Hands-on experience running LLM or ML workloads in production.
• Strong grounding in statistics and experimentation, including experiment design, hypothesis testing, sampling, and confidence intervals.
• Strong Python and software engineering fundamentals, plus experience designing evaluations and interpreting results rigorously.

Nice to have

• Fine-tuning and serving open-weight models; building LLM evaluation platforms, model gateways, or routing systems.
• Experience with agentic workloads, benchmarks, or RL environments; research-to-production record; or an MS or PhD in a related field.

Pay

$208,000 — $315,000 USD base salary

Tools

Python, LoRA

AI focus

Build and evaluate systems for frontier AI data, including agentic evaluations, model routing, fine-tuned small models, predictive task difficulty, and LLM-as-judge measurement.