Inferact
Member of Technical Staff, Exceptional Generalist (Remote)
Remote · Remote · Staff · Full-time · Posted Jan 22, 2026
- Education
- Bachelor's degree or equivalent experience in computer science, engineering, or similar.
- Visa sponsorship
- Visa sponsorship is available on a case-by-case basis.
About the job
Build and improve vLLM inference infrastructure, spanning runtime and kernel optimization, distributed systems, and cloud orchestration.
What you'll do
- Optimize inference runtime, GPU kernels, and model execution across hardware.
- Build distributed systems and orchestration infrastructure for large-scale model serving.
- Ship high-impact technical projects autonomously and collaborate asynchronously across time zones.
What they ask for
- Bachelor's degree or equivalent experience in computer science, engineering, or similar.
- Demonstrated autonomy and ability to drive projects to completion with minimal supervision.
- Strong asynchronous communication and a track record of shipping high-impact work in complex technical environments.
- Deep expertise in at least one of systems programming, GPU/accelerator programming, distributed systems, or ML infrastructure; strong in at least two listed technical areas.
Nice to have
- Contributions to vLLM or other major open-source ML/systems projects.
- Experience with multiple accelerator platforms, quantization, kernel optimization, or compiler technologies.
Tools
CUDA, Triton, TileLang, Pallas, Rust, Go, C++, Python
AI focus
Optimize AI inference for LLM and diffusion models, including model serving, GPU kernels, and inference infrastructure.
Model-written summary · the original posting is authoritative