Senior Machine Learning Engineer

What you'll do

• Design evaluation pipelines for LLM and agentic systems, combining automated graders, regression tests, production feedback, and human evaluation.
• Diagnose production failures and improve model behavior through interventions such as prompting, retrieval, data, and fine-tuning.
• Build and operate agentic systems and data-improvement loops, from orchestration and serving through observability and production debugging.

What they ask for

• 5+ years in production ML, research engineering, or applied AI, including building or materially improving a production AI system.
• Experience evaluating LLMs, agents, or other complex AI systems and building production systems involving models, tools, retrieval, or orchestration.
• Proficient in Python and modern ML frameworks; comfortable with deployment, observability, CI/CD, and containerized systems.
• Experience building high-quality datasets and feedback loops using production failures, user feedback, or active learning.

Nice to have

• PyTorch.
• Experience with realtime voice, conversational AI, multimodal systems, fine-tuning, healthcare, or regulated industries.

Pay

$204K – $255K (base salary)

Tools

Python, PyTorch, LLMs, transformers, CI/CD

AI focus

Build and improve clinical AI, including LLM evaluation, agentic systems, retrieval, and production model behavior.