Glean
AI Engineer - Quality and Post-Training
$200K–$280K
San Francisco Bay Area +2 · Full-time · Posted Oct 22, 2026
- Location
- San Francisco Bay Area
Mountain View, California, United States
San Francisco, California, United States - Experience
- 5+ years of industry experience in AI or Machine Learning Engineering.
About the job
Improves the quality of Glean’s AI models and agents through evaluation, post-training, and production engineering.
What you'll do
- Use evaluation results and production traces to improve agent harnesses, model routing, prompts, and retrieval while balancing quality, latency, and cost.
- Post-train models and build RL environments, evaluation sets, and LLM-based verifiers for enterprise workflows.
- Calibrate evaluations against human graders and collaborate across product, platform, and research teams to ship quality improvements.
What they ask for
- Hands-on experience post-training LLMs, including adapting open-weight models to specialized tasks.
- Experience building evaluations for AI assistants and agents, including evalsets, LLM-as-a-judge verifiers, and calibrated offline and online signals.
- Strong coding skills in Python and/or Go; proficiency in an ML framework; track record of shipping production ML systems.
- Product-minded approach and ability to turn ambiguous problems into concrete experiments in a cross-functional team.
Nice to have
- TypeScript is a plus.
Pay
$200,000 - $280,000 annually (base salary)
Tools
Python, Go, TypeScript, SFT, DPO, PPO, GRPO
AI focus
Post-training LLMs, developing evaluation and verification systems, and improving AI assistants and autonomous agents for enterprise workflows.
Model-written summary · the original posting is authoritative