Drimva

ByteDance

Senior Production System Engineer - New York City

New York, New York · Senior · Full-time · Posted Oct 28, 2026

Experience
5+ years; no alternative stated.
Education
Bachelor’s degree in Computer Science, Computer Engineering, Electrical Engineering, Information Technology, or a related field, or equivalent practical experience.

About the job

Leads the evaluation, integration, rollout, and reliable operation of large-scale GPU infrastructure for AI training and inference across data centers.

What you'll do

  • Qualify and productionize current- and next-generation GPU platforms, including rack-scale systems, and define end-to-end production readiness.
  • Build automation, telemetry, and operational frameworks for GPU fleet provisioning, monitoring, troubleshooting, incident response, and lifecycle management.
  • Lead cross-functional infrastructure initiatives and complex production incidents; participate in global on-call operations.

What they ask for

  • Bachelor’s degree in a related field or equivalent practical experience, with 5+ years in production systems, infrastructure engineering, SRE, DevOps, hardware systems engineering, or large-scale data center operations.
  • Hands-on ownership of introducing and productionizing large-scale GPU infrastructure, including a recent-generation or technically comparable rack-scale AI system.
  • Deep Linux administration and troubleshooting knowledge, server architecture, and hardware management technologies.
  • Experience supporting distributed AI training or inference, production-grade infrastructure automation, and monitoring or telemetry at substantial scale; practical use of AI or large language models in engineering workflows.

Nice to have

  • Direct experience with GB200 or GB300 NVL72 systems, or preparing environments for Vera Rubin NVL72.
  • Experience with large-scale GPU clusters, AI workload performance analysis, Kubernetes GPU Operator, Slurm, Ansible, infrastructure as code, CI/CD, or GPU platform vendors.

Tools

Linux, Python, Go, Bash, CUDA, NCCL, NVLink, NVSwitch

AI focus

Applies AI technologies or large language models to incident triage and analysis, troubleshooting, knowledge retrieval, code generation, and automated remediation; supports infrastructure for AI training and inference.

Model-written summary · the original posting is authoritative

First seen Oct 28, 2026 · Last verified Nov 6, 2026 (UTC)