ByteDance
Software Engineer Graduate (AML-Engine-Orchestration) - 2027 Start
San Jose, California · Full-time · Posted Oct 28, 2026
- Education
- Bachelor's or Master's degree in Computer Science, Software Engineering, Artificial Intelligence, or a related technical field; candidates may be completing or have recently completed the degree.
About the job
Builds orchestration and resource-management systems for machine-learning infrastructure and online model serving across ByteDance products.
What you'll do
- Develop orchestration capabilities for workloads, including Kubernetes Operators, container runtimes, and lifecycle management.
- Build multi-tenant resource scheduling and quota systems to improve GPU utilization and cost efficiency.
- Develop model-serving lifecycle, traffic management, scheduling, scaling, and disaster-recovery capabilities.
What they ask for
- Completing or recently completed a Bachelor's or Master's degree in Computer Science, Software Engineering, Artificial Intelligence, or a related technical field.
- Proficiency in at least one of Go, C++, or Python, with foundations in data structures, algorithms, and software engineering.
- Familiarity with Linux and foundational understanding of operating systems, computer networks, concurrent programming, and distributed systems.
- Demonstrated ownership and collaboration through engineering projects, coursework, research, internships, or open-source contributions.
Nice to have
- Experience with Kubernetes, container runtimes, resource scheduling, quota management, multi-tenant systems, or FinOps.
- Experience with model-serving systems, online services, traffic management, autoscaling, distributed systems, or GPU/NPU programming.
Tools
Go, C++, Python, Linux, Kubernetes, Volcano, Koordinator, OpenKruise
AI focus
Builds machine-learning infrastructure and orchestration for online model serving, including model deployment, scaling, scheduling, and traffic management.
Model-written summary · the original posting is authoritative