Momentic
AI Engineer
$175K–$250K
San Francisco · On-site · Full-time · Posted Oct 25, 2026
- Experience
- Typically 3+ years of relevant software engineering experience; experience may include owning an AI capability within a larger product.
About the job
Improve the models and agents behind Momentic’s AI-native software testing platform, from fine-tuning and evaluation to production reliability and performance.
What you'll do
- Fine-tune models and build training and evaluation datasets from production workflows.
- Develop LLM evaluations and observability, and tune prompts, context, and model behavior for reliability, latency, token usage, and cost.
- Design experiments and benchmarks, and own technical projects through delivery.
What they ask for
- Relevant software engineering experience, typically 3+ years, including hands-on contributions to AI-powered capabilities used in production.
- Hands-on supervised fine-tuning experience, including preparing training data and evaluating model behavior.
- Experience with prompt and context tuning, evaluation datasets, and LLM observability.
- Strong engineering fundamentals and ability to work autonomously through ambiguity.
Nice to have
- Experience with reinforcement learning fine-tuning or LLM-as-judge evaluators.
- Experience with long-running agents, recovery from failed steps, coordinating multiple agents, publishing benchmarks, or rigorous AI experiments.
Pay
$175K – $250K USD base salary
AI focus
Fine-tuning models and improving long-running AI agents for software testing, including building datasets, evaluations, observability, and benchmarks.
Model-written summary · the original posting is authoritative