Drimva

ByteDance

Software Engineer Graduate (AI Compute) - 2027 Start (PhD)

San Jose, California · Full-time · Posted Oct 28, 2026

Education
PhD in Software Development, Computer Science, Computer Engineering, or a related technical discipline; completing or recently completed.

About the job

Build and operate cloud-native, GPU-optimized infrastructure for large-scale LLM inference and AI workloads.

What you'll do

  • Design and build scalable, resilient container-based cluster management and orchestration systems.
  • Architect GPU and AI accelerator infrastructure for cost-efficient, secure ML platforms.
  • Develop production-ready inference solutions in collaboration with teams using LLM engines and open-source technologies.

What they ask for

  • Completing or recently completed a PhD in Software Development, Computer Science, Computer Engineering, or a related technical discipline.
  • Strong understanding of large-model inference, distributed and parallel systems, and/or high-performance networking.
  • Hands-on experience building cloud or ML infrastructure, such as resource management, scheduling, request routing, monitoring, or orchestration.
  • Knowledge of Docker and Kubernetes, and proficiency in Go, Rust, Python, or C++.

Nice to have

  • Experience with large-scale cluster management, GPU orchestration, workload scheduling, or GPU programming.
  • Familiarity with inference engines, public cloud ML platforms, and distributed ML systems.

Tools

Docker, Kubernetes, Go, Rust, Python, C++, vLLM, SGLang

AI focus

Build GPU-optimized infrastructure and systems for large-scale LLM inference and AI workloads.

Model-written summary · the original posting is authoritative

First seen Oct 28, 2026 · Last verified Nov 5, 2026 (UTC)