Scale AI
Senior Infrastructure Software Engineer, Enterprise AI
$216K–$270K
New York, NY +2 · Senior · Full-time · Posted Aug 20, 2025
- Location
- New York, NY
San Francisco, CA
San Francisco, California, United States - Experience
- 5+ years of full-time software engineering experience; proven experience in a senior role.
About the job
Leads the design and delivery of multi-cloud infrastructure for enterprise AI platforms, including secure, reliable agentic workflows and observability.
What you'll do
- Architect multi-cloud infrastructure and deployment patterns for enterprise agentic workflows.
- Improve reliability and engineering efficiency across CI/CD, testing, data quality, and incident response.
- Lead infrastructure strategy, security, compliance, and developer tooling, while collaborating with platform and product teams.
What they ask for
- 5+ years of full-time software engineering experience and proven experience in a senior role.
- Deep knowledge of CI/CD, IaC, container orchestration, and observability platforms.
- Extensive experience with at least one major cloud provider: AWS, Azure, or GCP.
- Strong enterprise security and compliance knowledge, plus proficiency in Python or JavaScript/TypeScript and SQL.
Nice to have
- Hands-on experience and interest in Agents, LLMs, vector databases, or emerging AI technologies.
Pay
$216,200 — $270,250 USD base salary
Tools
GCP, Azure, AWS, Terraform, Helm Charts, Kubernetes, Datadog, Prometheus
AI focus
Build infrastructure for knowledge retrieval, inference, and multi-agent systems; use AI platform data to analyze engineering logs and metrics. Agent, LLM, and vector database experience is a bonus.
Model-written summary · the original posting is authoritative