ByteDance
Senior Production System Engineer - San Jose
San Jose, California · Senior · Full-time · Posted Oct 28, 2026
- Experience
- 5+ years in production systems, infrastructure engineering, Site Reliability Engineering, DevOps, hardware systems engineering, or large-scale data center operations.
- Education
- Bachelor’s degree in Computer Science, Computer Engineering, Electrical Engineering, Information Technology, or a related field, or equivalent practical experience.
About the job
Leads the introduction, productionization, and reliable operation of large-scale GPU infrastructure for AI training and inference across data centers.
What you'll do
- Evaluate, integrate, validate, and roll out rack-scale GPU platforms; define production-readiness criteria across hardware, firmware, software, networking, and operations.
- Build automation and telemetry for provisioning, monitoring, fault response, and lifecycle management; investigate incidents and improve fleet reliability.
- Lead cross-functional infrastructure programs, coordinate vendors and global teams, and participate in on-call operations.
What they ask for
- Bachelor’s degree in a related field or equivalent practical experience.
- Hands-on experience productionizing large-scale GPU infrastructure, including a recent-generation platform such as NVIDIA GB200/GB300 NVL72, HGX or DGX B200/B300, or comparable rack-scale AI systems.
- Deep Linux troubleshooting and server-management knowledge, plus experience supporting distributed AI workloads and containerized, orchestrated environments.
- Programming proficiency in Python, Go, Bash, or another language; experience with infrastructure automation, operational platforms, and applying AI or large language models to engineering workflows.
Nice to have
- Direct experience with GB200 or GB300 NVL72 systems or preparing for NVIDIA Vera Rubin NVL72.
- Experience operating multi-region GPU clusters or with Kubernetes GPU Operator, Slurm, Ansible, infrastructure as code, or large-scale orchestration.
Tools
Linux, Python, Go, Bash, CUDA, NCCL, NVLink, NVSwitch
AI focus
Supports AI training and inference infrastructure and applies AI or large language models to incident triage, troubleshooting, knowledge retrieval, code generation, and automated remediation.
Model-written summary · the original posting is authoritative