Haize Labs
Staff+ Software Engineer, Backend and Infra
$200K–$300K
New York, NY +1 · Staff · Full-time · Posted Apr 10, 2025
- Location
- New York, NY
New York City - Experience
- 7+ years of industry experience, including 3+ years leading large initiatives as an engineer or manager.
- Education
- Bachelor’s degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.
- Visa sponsorship
- US visa sponsorship available for exceptional candidates.
About the job
Build and lead backend and infrastructure systems for an AI reliability platform that tests, evaluates, and safeguards LLM-based applications in production.
What you'll do
- Design and build scalable infrastructure to orchestrate tens of thousands of LLM calls per second for evaluations, red-team attacks, and runtime guardrails.
- Collaborate with research to deploy new models and work with customers on pain points, workflows, and evaluation methods.
- Provide technical leadership through mentoring, setting technical direction, and establishing operational best practices.
What they ask for
- 7+ years of industry experience, including 3+ years leading large initiatives as an engineer or manager.
- Proven track record designing, building, and scaling complex distributed systems.
- Strong proficiency in one or more backend programming languages, such as Python, Go, or Rust.
- Knowledge of modern cloud infrastructure and platforms, and relational and NoSQL databases.
Nice to have
- Experience in applied AI/ML, security and privacy, large-scale GPU-based model training and serving, or multi-datacenter cloud-agnostic systems.
Pay
$200,000 – $300,000 USD annual salary
Tools
Python, Go, Rust, Kubernetes, Terraform, AWS, GCP, Azure
AI focus
Build AI reliability tooling, including model evaluations, red-team attacks, runtime guardrails, and deployment of new models.
Model-written summary · the original posting is authoritative