Microsoft
Principal Software Engineer for Copilot Evals
$143K–$304K
Redmond, WA · On-site · Principal · Full-time · Posted Oct 12, 2026
- Experience
- 6+ years of technical engineering experience; equivalent experience is also accepted.
- Education
- Bachelor's Degree in Computer Science or related technical field, or equivalent experience.
About the job
Architects and delivers CADET’s production system for continuously turning customer evidence into automated Copilot evaluations, quality diagnosis, reporting, and product improvements.
What you'll do
- Own the end-to-end architecture, integration contracts, and technical execution of the customer-signal and evaluation system.
- Build scalable services and pipelines for customer-signal processing, evaluation execution, quality attribution, and regression protection.
- Establish observability, human-review gates, engineering standards, and reusable capabilities across partner teams.
What they ask for
- Bachelor's Degree in Computer Science or related technical field and 6+ years of technical engineering experience coding in languages including C, C++, C#, Java, JavaScript, or Python; OR equivalent experience.
Nice to have
- Experience designing and delivering large-scale distributed systems, data platforms, developer platforms, or AI infrastructure in production, with practical exposure to LLMs, agent systems, or AI/ML platforms.
- Principal-level technical leadership across teams and organizational boundaries; experience with evaluation infrastructure, experimentation systems, model pipelines, or related AI systems.
Pay
USD $142,800 - $274,800 per year (base salary); USD $188,000 - $304,200 per year (base salary)
Tools
C, C++, C#, Java, JavaScript, Python
AI focus
Builds an agentic, automated Copilot quality system involving AI agents, evaluation infrastructure, LLM and agent systems, automated diagnosis, and human review.
Model-written summary · the original posting is authoritative