Yotta Labs
Research Engineer - AI Systems
United States +3 · Remote · Full-time · Posted Jun 28, 2026
- Location
- United States
Hong Kong
Canada
Singapore - Education
- A background in computer science, engineering, or a related field is preferred.
About the job
Develop and optimize kernels, runtimes, and distributed training and inference systems for AI workloads across NVIDIA, AMD, and AWS Trainium accelerators.
What you'll do
- Design, implement, and optimize high-performance kernels and custom operators for multiple accelerator platforms.
- Improve inference runtimes and build scalable distributed training and inference solutions.
- Contribute to open-source projects, publish technical findings, and engage with the developer community.
What they ask for
- Proficiency in Python and C++.
- Deep understanding of GPU architecture and performance optimization.
- Experience with CUDA, Triton, ROCm/HIP, or AWS Neuron.
- Strong understanding of AI frameworks, model architectures, and profiling tools.
Nice to have
- Contributions to open-source AI infrastructure projects.
- Experience with FlashAttention, PagedAttention, MoE, RLHF, or distributed AI systems; publications at the listed conferences.
Tools
Python, C++, CUDA, Triton, ROCm/HIP, AWS Neuron, PyTorch/XLA, Neuron SDK
AI focus
AI systems research and optimization, including accelerator kernels, LLM inference, and distributed training and inference.
Model-written summary · the original posting is authoritative