Software Engineer, Machine Learning Infrastructure

What you'll do

• Research and optimize online prediction frameworks for efficient model recommendation.
• Process large-scale feature samples across data flow conversion, model training, and parameter tuning.
• Work with algorithm teams to solve technical challenges and support business needs.

What they ask for

• Bachelor’s degree or above in Computer Science or a related field, with experience building scalable systems.
• Proficiency in C/C++ in a Linux environment.
• Familiarity with operating system concepts, computer architecture, and the underlying frameworks of TensorFlow or PyTorch.
• Background in High Performance Computing, Applied ML models (MLP/Transformer/MoE), ML Hardware Acceleration (e.g., GPU/RDMA), or ML Systems.

Nice to have

• Experience in deep learning model training and prediction, or algorithm implementation and optimization.
• Familiarity with model pruning, quantization, and compression; experience with software-hardware integration and optimization.

Tools

C/C++, Linux, TensorFlow, PyTorch, GPU, RDMA

AI focus

Machine learning infrastructure for recommendation systems, including online prediction, feature processing, model training, and optimization.