AI Infra Engineer Graduate (Recommendation & LLM) - 2027 Start

What you'll do

• Build infrastructure for large-scale model training and online inference; develop distributed systems for recommendation models and LLMs.
• Improve training and inference performance through GPU and communication optimization, and analyze system bottlenecks.
• Collaborate with researchers to develop and deploy LLM training and serving solutions.

What they ask for

• Completing or recently completed a Bachelor's degree in Computer Science or a related discipline.
• Strong programming skills in C++ or Python.
• Good understanding of data structures, algorithms, and computer systems; familiarity with PyTorch or TensorFlow.
• Knowledge of Transformer architectures and Large Language Models (LLMs).

Nice to have

• Hands-on LLM training or inference experience through research, internships, or open-source projects; familiarity with distributed training concepts.
• GPU programming with CUDA, Triton, or similar technologies; understanding of LLM serving techniques or contributions to relevant open-source projects or research.

Tools

C++, Python, PyTorch, TensorFlow, CUDA, Triton, FSDP, ZeRO

AI focus

Develop infrastructure for recommendation models and LLMs, including distributed training, online inference, GPU optimization, and LLM training and serving.