ByteDance
Software Engineer - AI Compute Infrastructure
Seattle, Washington · Full-time · Posted Oct 28, 2026
- Experience
- 2+ years of relevant experience; Ph.D. with strong systems/ML publications also considered.
- Education
- B.S./M.S. in Computer Science, Computer Engineering, or related fields; Ph.D. with strong systems/ML publications also considered.
About the job
Build and operate scalable, cloud-native, GPU-optimized infrastructure for large-scale LLM inference and AI workloads.
What you'll do
- Design and build high-performance, resilient container-based cluster management and orchestration systems.
- Architect GPU and AI accelerator infrastructure for cost-efficient, secure ML platforms.
- Collaborate on LLM inference solutions and write production-ready code.
What they ask for
- B.S./M.S. in Computer Science, Computer Engineering, or a related field; Ph.D. with strong systems/ML publications also considered.
- Strong understanding of large-model inference, distributed and parallel systems, and/or high-performance networking.
- Hands-on experience building cloud or ML infrastructure, such as resource management, scheduling, request routing, monitoring, or orchestration.
- Knowledge of Docker and Kubernetes, and proficiency in Go, Rust, Python, or C++.
Nice to have
- Experience with large-scale cluster management, workload scheduling, GPU orchestration, or GPU programming.
- Experience with inference engines, public cloud ML platforms, or ML systems such as Ray, DeepSpeed, and PyTorch.
Tools
Docker, Kubernetes, Go, Rust, Python, C++, vLLM, SGLang
AI focus
Develop GPU-optimized infrastructure and orchestration for large-scale LLM inference and AI workloads; integrate inference engines and AI accelerators.
Model-written summary · the original posting is authoritative