AIML - Distinguished Engineer, Foundation Model

What you'll do

• Own the inference engine’s technical strategy and roadmap; drive performance, efficiency, and reliability improvements.
• Partner with research and internal teams to build inference capabilities and extend systems into training infrastructure, data pipelines, and evaluation.
• Lead engineers across teams, deliver milestones, and mentor engineers.

What they ask for

• MS or PhD in Computer Science, Machine Learning, or a related technical field, or equivalent industry experience.
• 15+ years building large-scale ML or distributed systems, with technical leadership and broad impact.
• Deep, hands-on expertise in foundation-model inference engines and experience supporting varied inference use cases.
• Understanding of accelerator architecture, distributed systems, and model optimization; proficiency with ML frameworks such as JAX and PyTorch; demonstrated engineering leadership and mentoring.

Nice to have

• Experience with large-scale LLM and multimodal inference, including training or evaluation loops.
• Familiarity with Kubernetes, Docker, cloud platforms (AWS, GCP, Azure), and distributed computing frameworks.

Pay

$311,100 and $496,900 (base salary)

Tools

JAX, PyTorch, Kubernetes, Docker, AWS, GCP, Azure

AI focus

Leads foundation-model inference systems used for data generation, training rollouts, evaluation, and LLM-as-judge scoring; improves model-serving performance and supports training, data, and evaluation systems.