SAP
Principal Machine Learning Engineer
Palo Alto, CA, United States · Hybrid · Principal · Full-time · Posted Sep 30, 2026
- Experience
- 10+ years of software engineering experience.
- Education
- Bachelor's degree in Computer Science, Mathematics, Physics, or related field.
About the job
Architects and leads the deployment of large-scale machine-learning systems, shaping technical standards and AI direction across products and teams.
What you'll do
- Design and optimize large-scale ML systems and infrastructure, ensuring production readiness and business, performance, scalability, and governance requirements.
- Lead deployment and define architectural and operational standards, including performance, security, and model governance practices.
- Mentor engineers, advise stakeholders, and influence technical direction and adoption of modern ML techniques across teams.
What they ask for
- 10+ years of software engineering experience delivering complex systems.
- Bachelor's degree in Computer Science, Mathematics, Physics, or a related field.
- Production AI/ML experience with LLMs, RAG, prompt engineering, vector search, agent workflows, and model evaluation.
- Expertise in distributed systems and large-scale enterprise architecture; strong programming skills, ML frameworks, and MLOps practices.
Tools
large language models (LLM), retrieval-augmented generation (RAG), prompt engineering, vector search, agent workflows, MLOps
AI focus
Architect and scale production ML systems and LLM infrastructure; apply modern AI techniques, including RAG and agent workflows, and ensure model evaluation, governance, explainability, and safe experimentation.
Model-written summary · the original posting is authoritative