ByteDance
Software Engineer Graduate (AI Compute) - 2027 Start (PhD)
Seattle, Washington · Full-time · Posted Oct 28, 2026
- Education
- PhD in Software Development, Computer Science, Computer Engineering, or a related technical discipline; candidates may be completing or have recently completed the degree.
About the job
Builds cloud-native, GPU-optimized infrastructure for large-scale LLM inference and AI workloads.
What you'll do
- Design and build scalable, resilient container-based cluster management and orchestration systems.
- Architect cloud-native GPU and AI accelerator infrastructure for cost-efficient, secure ML platforms.
- Develop production-ready inference solutions with other teams, using LLM engines and open-source technologies.
What they ask for
- Completing or recently completed a PhD in Software Development, Computer Science, Computer Engineering, or a related technical discipline.
- Strong understanding of large-model inference, distributed and parallel systems, and/or high-performance networking.
- Hands-on experience building cloud or ML infrastructure, such as resource management, scheduling, request routing, monitoring, or orchestration.
- Knowledge of Docker and Kubernetes, and proficiency in at least one of Go, Rust, Python, or C++.
Nice to have
- Experience contributing to or operating large-scale cluster management systems, or with production workload scheduling, GPU orchestration, scaling, and isolation.
- Experience with CUDA or inference engines; familiarity with public cloud ML platforms or ML systems.
Tools
Kubernetes, Ray, vLLM, SGLang, TensorRT-LLM, Docker, Go, Rust
AI focus
Develop GPU-optimized infrastructure and inference solutions for LLMs and other AI/ML workloads.
Model-written summary · the original posting is authoritative