ByteDance
Software Engineer Intern (AML-Engine-Orchestration) - 2027 Start
Seattle, Washington · Internship · Posted Oct 28, 2026
- Education
- Currently pursuing a Bachelor's or Master's degree in Computer Science, Software Engineering, Artificial Intelligence, or a related technical field.
About the job
Builds orchestration, scheduling, and resource-management infrastructure for machine-learning workloads and online model serving across ByteDance products.
What you'll do
- Develop foundational orchestration capabilities for jobs, services, and stateful workloads.
- Build multi-tenant resource scheduling and quota systems to improve GPU utilization and cost efficiency.
- Develop model-serving lifecycle orchestration, traffic management, and reliability capabilities.
What they ask for
- Currently pursuing a Bachelor's or Master's degree in Computer Science, Software Engineering, Artificial Intelligence, or a related technical field.
- Proficiency in at least one of Go, C++, or Python, with foundations in data structures, algorithms, and software engineering.
- Familiarity with Linux and foundational knowledge of operating systems, computer networks, concurrent programming, and distributed systems.
- Demonstrated ownership and collaboration through coursework, research, internships, open-source contributions, or other engineering projects.
Nice to have
- Experience with Kubernetes, container runtimes, resource scheduling, quota management, multi-tenant systems, or FinOps.
- Experience with model-serving systems such as vLLM, SGLang, Triton, KServe, or Ray Serve.
Tools
Kubernetes, Go, C++, Python, Linux, Volcano, Koordinator, OpenKruise
AI focus
Builds infrastructure for machine-learning workload orchestration and online model serving, including scheduling, deployment, scaling, and traffic management.
Model-written summary · the original posting is authoritative