ByteDance
Software Engineer Graduate (AML-Engine-Orchestration) - 2027 Start (PhD)
Seattle, Washington · Full-time · Posted Oct 28, 2026
- Education
- PhD in Computer Science, Software Engineering, Artificial Intelligence, or a related technical field; completing or recently completed.
About the job
Builds large-scale orchestration and resource-management infrastructure for machine-learning workloads and online model serving across ByteDance products.
What you'll do
- Design orchestration capabilities for jobs, services, and stateful workloads, including Kubernetes Operators and container runtimes.
- Develop multi-tenant resource scheduling and quota systems to improve GPU utilization and cost efficiency.
- Build model-serving lifecycle, traffic-management, and reliability capabilities, including deployment, autoscaling, routing, and disaster recovery.
What they ask for
- Completing or recently completed a PhD in Computer Science, Software Engineering, Artificial Intelligence, or a related technical field.
- Proficiency in at least one of Go, C++, or Python, with foundations in data structures, algorithms, and software engineering.
- Familiarity with Linux and foundational knowledge of operating systems, computer networks, concurrent programming, and distributed systems.
- Hands-on investigative and quantitative problem-solving abilities, plus demonstrated ownership and collaboration through projects or other experience.
Nice to have
- Experience with Kubernetes, container runtimes, resource scheduling, quota management, multi-tenant systems, or FinOps.
- Experience or contributions involving model-serving systems, infrastructure projects, online services, GPUs/NPUs, or inference performance.
Tools
Kubernetes Operators, Go, C++, Python, Linux, Kubernetes, Volcano, Koordinator
AI focus
Builds infrastructure that orchestrates machine-learning workloads and online model serving, including model deployment and serving traffic management.
Model-written summary · the original posting is authoritative