Atlassian
Principle Machine Learning Systems Engineer
$196K–$309K
San Francisco, United States +1 · Full-time · Posted Oct 28, 2026
- Location
- San Francisco, United States
Remote, Remote
About the job
Leads the design and delivery of production ML and evaluation systems that improve Rovo Chat’s quality, agent capabilities, and customer outcomes.
What you'll do
- Set technical direction for evaluating and improving Rovo Chat; build scalable evaluation systems, datasets, simulations, and quality signals.
- Advance agent capabilities and turn identified failure modes into production interventions with measured product impact.
- Lead cross-organizational initiatives and mentor engineers through technical leadership, design reviews, and reusable quality standards.
What they ask for
- Track record architecting and shipping large-scale ML or AI systems with measurable customer and business impact.
- Deep experience with LLM-powered products, agentic systems, model evaluation, experimentation, and dataset development.
- Strong production engineering skills and ability to work hands-on in a modern ML stack.
- Principal-level technical leadership, product and technical judgment, and clear communication and mentorship skills.
Pay
$236,700 - $309,025 USD base salary; $213,030 - $278,123 USD base salary; $196,461 - $256,491 USD base salary
AI focus
Develops and evaluates Rovo Chat’s AI and agentic capabilities, including reasoning, planning, tool use, retrieval, memory, model evaluation, and production interventions.
Model-written summary · the original posting is authoritative