Gimlet Labs
Member of Technical Staff - Compiler Engineer
$180K–$400K
San Francisco, CA · On-site · Staff · Full-time · Posted Mar 10, 2026
About the job
Build and optimize Gimlet’s AI compiler stack to run inference workloads efficiently across heterogeneous hardware.
What you'll do
- Develop compiler abstractions, dialects, passes, and lowering paths to support new hardware targets.
- Optimize end-to-end inference performance, including operator fusion, execution planning, and kernel selection or generation.
- Enable new models and serving techniques to run efficiently across multiple hardware targets.
What they ask for
- Experience building ML compilers and runtimes, with a focus on performance optimization.
- Experience with MLIR, LLVM, or comparable compiler infrastructure.
- Experience designing intermediate representations, compiler passes, or lowering and code-generation pipelines.
- Strong C++ and/or Python skills; understanding of SSA, memory systems, scheduling, and hardware efficiency.
Nice to have
- Experience optimizing ML inference or model-serving workloads.
- Experience with automated kernel generation, autotuning, or search-based optimization.
Pay
$180K – $400K (base salary)
Tools
MLIR, LLVM, C++, Python, IREE, XLA, TVM, Triton
AI focus
Compiler work for AI inference, including heterogeneous execution, agent-driven kernel generation, model support, and serving optimization.
Model-written summary · the original posting is authoritative