ByteDance
Software Engineer Graduate (AML-Engine-Orchestration) - 2027 Start (PhD)
San Jose, California · Full-time · Posted Oct 28, 2026
- Education
- PhD in Computer Science, Software Engineering, Artificial Intelligence, or a related technical field; completing or recently completed.
About the job
Build machine-learning infrastructure for orchestration, resource scheduling, and online model serving across ByteDance products.
What you'll do
- Develop orchestration capabilities for machine-learning workloads, including Kubernetes Operators, container runtimes, and workload lifecycle management.
- Build multi-tenant resource scheduling and quota systems to improve GPU utilization and cost efficiency.
- Develop model-serving lifecycle orchestration, traffic management, autoscaling, and multi-cluster reliability capabilities.
What they ask for
- Completing or recently completed a PhD in Computer Science, Software Engineering, Artificial Intelligence, or a related technical field.
- Proficiency in at least one of Go, C++, or Python, with foundations in data structures, algorithms, and software engineering.
- Familiarity with Linux and foundational knowledge of operating systems, computer networks, concurrent programming, and distributed systems.
- Strong hands-on investigation, quantitative problem-solving, ownership, and collaboration abilities.
Nice to have
- Experience with Kubernetes, container runtimes, scheduling, quota management, multi-tenant systems, or FinOps.
- Experience with model-serving systems, online services, traffic management, GPU/NPU programming, or related infrastructure.
Tools
Kubernetes Operators, Go, C++, Python, Linux, Kubernetes, Volcano, Koordinator
AI focus
Build infrastructure for machine-learning workload orchestration and online model serving, including scheduling, model distribution, and serving traffic management.
Model-written summary · the original posting is authoritative