Datadog
Distinguished Architect, AI
$330K–$440K
New York, New York, USA +3 · Principal · Full-time · Posted May 29, 2026
- Location
- New York, New York, USA
San Francisco, California, USA
New York, NY, United States
San Francisco, CA, United States - Experience
- 10+ years in at-scale distributed systems architecture, high-performance computing, or large-scale infrastructure.
- Education
- Bachelor’s degree in engineering or related field; Master’s degree preferred.
About the job
Advise leading AI companies on infrastructure and observability architecture, connect their needs to Datadog’s roadmap, and help develop integrations for large-scale AI workloads.
What you'll do
- Lead customer architecture reviews and advise technical leaders on AI adoption, best practices, and observability.
- Identify emerging AI technology needs and collaborate with Product Management and Product SAs on observability integrations and solutions.
- Provide technical leadership across customer-facing teams and assist with recruiting for PSA and Field CTO teams.
What they ask for
- 10+ years of experience with at-scale distributed systems architecture, high-performance computing, or large-scale infrastructure.
- Deep familiarity with the AI/LLM ecosystem, accelerator hardware (GPUs/TPUs), and modern orchestration frameworks.
- Hands-on expertise in AI/LLM Ops and LLM Observability (LLMO), with credibility whiteboarding solutions for senior engineers.
- Excellent customer-facing presentation and communication skills; able to travel up to 50% of the time.
Nice to have
- Master’s degree.
Pay
$330,000 — $440,000 USD (yearly salary; base or total pay not specified)
Tools
GPUs/TPUs
AI focus
Advise AI labs and AI-native companies on AI/LLM adoption, infrastructure, and observability for training and deploying foundational models at scale; shape Datadog’s roadmap and co-create observability integrations.
Model-written summary · the original posting is authoritative