Amazon
Sr. Machine Learning - Compiler Engineer III, AWS Neuron, Annapurna Labs
$193K–$262K
Cupertino, CA · Senior · Full-time · Posted May 1, 2026
- Experience
- 5+ years leading system design or architecture; 2+ years developing compiler features and optimizations.
- Education
- Master or PhD degree in computer science or equivalent (preferred).
About the job
Build and optimize the AWS Neuron compiler so machine-learning models can run efficiently on AWS Inferentia and Trainium accelerators.
What you'll do
- Design, implement, test, deploy, and maintain compiler software, including optimization and verification passes and tools for numerical-error analysis.
- Work with chip architects, runtime and OS engineers, scientists, and ML application teams to improve model deployment and accelerator performance.
- Diagnose compiler defects and collaborate with open-source communities and internal and external stakeholders.
What they ask for
- 5+ years leading design or architecture of new and existing systems, including design patterns, reliability, and scaling.
- 2+ years developing compiler features and optimizations.
- Proficiency in at least one of C++ (preferred), C, or Python.
Nice to have
- Master’s or PhD in computer science or equivalent.
- Experience optimizing TensorFlow, PyTorch, or JAX models; resource management, scheduling, code generation, compute graph optimization, or multiple toolchains and Instruction Set Architectures.
Pay
193,300.00 - 261,500.00 USD annually (base salary)
Tools
C++, C, Python, TensorFlow, PyTorch, JAX, OpenXLA, StableHLO
AI focus
Compiler optimization and deployment of machine-learning models, including large language models, diffusion models, and vision transformers, on AWS accelerators.
Model-written summary · the original posting is authoritative