Customer Engineer, Infrastructure

What you'll do

• Troubleshoot, triage, escalate, and resolve customer issues end-to-end, coordinating with engineering as needed.
• Advise and support key customers, track bugs and feature requests, and provide updates through resolution.
• Improve internal tools and documentation, and collaborate with product and engineering to improve the customer experience.

What they ask for

• 7+ years of experience in a Machine Learning role in a dynamic, fast-paced, startup-like environment.
• Proficiency developing data pipelines for training, fine-tuning, and inference/serving of LLMs.
• Experience running and optimizing infrastructure for distributed ML workloads on major cloud platforms (AWS/EKS, GCP/GKE, or Azure/AKS).
• Strong organizational skills, communication and interpersonal skills, and ability to manage multiple customer needs simultaneously.

Nice to have

• Experience with Ray.
• Knowledge of MLOps platforms, container orchestration platforms (e.g., Kubernetes), infrastructure as code (e.g. Terraform), or CI/CD tools (e.g. Github Actions).

Pay

$170K – $199K (base salary)

Tools

Anyscale, Ray, LLMs, AWS/EKS, GCP/GKE, Azure/AKS, Kubernetes, Terraform

AI focus

Supports customers using distributed ML infrastructure and LLM training, fine-tuning, inference, and serving workloads.