Software Engineer, AI Kernels & Performance Optimization — MTIA Software

What you'll do

• Design, implement, profile, and optimize compute and communication kernels for MTIA, from architectural analysis through production deployment.
• Build kernel frameworks and libraries that expand PyTorch operator coverage and help other engineers achieve high performance.
• Partner with silicon, compiler, runtime, and framework teams on hardware/software co-design, performance fixes, and production model improvements.

What they ask for

• Bachelor's degree in Computer Science, Computer Engineering, a related technical field, or equivalent practical experience.
• 6+ years of professional experience in high-performance computing, accelerator kernel development, compiler backends, or systems performance engineering.
• Proficiency in C++ and Python, including low-level systems programming, templates, and generic programming.
• Demonstrated experience writing and optimizing kernels for a parallel architecture, plus working knowledge of computer architecture and measurement-driven performance analysis.

Nice to have

• Deep familiarity with transformer and attention kernel design, including FlashAttention-class algorithms, KV-cache management, and MoE routing.
• Experience with compiler/codegen technologies, low-precision numerics, distributed execution, kernel libraries, or pre-silicon development.

Pay

$154,003/year to $217,000/year USD base salary

Tools

C++, Python, PyTorch, CUDA, ROCm/HIP, SYCL/OpenCL, MLIR, LLVM

AI focus

Develop and optimize kernels and software frameworks for AI training and inference workloads, including recommendation, ranking, and generative AI; work on transformer and attention kernels, quantization, and AI accelerator performance.