General Legal
Senior ML Infra Engineer
$200K–$275K
New York, New York, United States, San Francisco, California, United States +2 · Senior · Full-time · Posted Aug 27, 2026
- Location
- New York, New York, United States, San Francisco, California, United States
New York, New York, United States
San Francisco, California, United States - Experience
- 5+ years of software engineering, machine learning engineering, or infrastructure experience.
- Education
- Computer Science degree or equivalent experience.
- Visa sponsorship
- Eligible to work in the US.
About the job
Build and operate infrastructure that helps research and engineering teams experiment with, evaluate, train, and deploy AI systems for legal work.
What you'll do
- Build infrastructure and reproducible systems for model training, evaluation, and serving.
- Develop data pipelines, production observability, and infrastructure for agentic workloads.
- Improve inference reliability, latency, throughput, and cost, and move research capabilities into production.
What they ask for
- 5+ years of software engineering, machine learning engineering, or infrastructure experience.
- Strong software engineering fundamentals and proficiency in Python.
- Experience building production ML infrastructure, with cloud infrastructure, distributed systems, and containerized workloads.
- Computer Science degree or equivalent experience; eligible to work in the US and able to work in-office at least 3 days a week in SF or NY.
Nice to have
- Experience with large language models, GPU infrastructure, distributed training or inference, reinforcement learning, post-training, or large-scale evaluation.
- Experience with AI agent infrastructure, inference optimization at scale, or an early-stage startup.
Pay
$200,000 - $275,000 USD base salary
Tools
Python
AI focus
Build infrastructure for AI model experimentation, evaluation, data generation, training, inference, deployment, and agentic workloads.
Model-written summary · the original posting is authoritative