ByteDance
LLM Backend Engineer Graduate (Applied Machine Learning) - 2027 Start
San Jose, California · Full-time · Posted Oct 28, 2026
- Education
- Bachelor's or Master's degree in Computer Science or a related discipline.
About the job
Develop backend and cloud-native components for Volcano Ark’s large model service platform, focusing on multimodal APIs, reliability, and inference performance.
What you'll do
- Build platform APIs for text dialogue, multimodal understanding, and multimodal generation.
- Help evolve cloud-native architecture and implement high-availability features such as traffic routing, degradation, circuit breaking, and rate limiting.
- Tune inference performance and maintain stability under high traffic and large-scale model invocation.
What they ask for
- Completing or recently completed a Bachelor's or Master's degree in Computer Science or a related discipline.
- Proficiency in at least one of Golang, Java, C++, or Python, with practical software development experience and solid computer science fundamentals.
- Understanding of backend engineering systems, including databases, computer networks, operating systems, and distributed systems.
Nice to have
- Hands-on server-side engineering experience.
- Knowledge of Agent concepts and implementations such as Function Calling and MCP, cloud-native technologies, or large model inference pipelines.
Tools
Golang, Java, C++, Python, Kubernetes, Docker, Istio, Envoy
AI focus
Supports multimodal large model inference and APIs, including text dialogue, multimodal understanding, and generation.
Model-written summary · the original posting is authoritative