Ambral
Member of Technical Staff (New Grad)
$140K–$175K
New York +1 · On-site · Staff · Full-time · Posted Aug 17, 2026
- Location
- New York
San Francisco - Experience
- Experience building production-grade software (internships are OK) or in a quant role; no years specified.
About the job
Build infrastructure that turns historical enterprise workflows into replayable environments and evaluation systems for improving AI agents.
What you'll do
- Work with customers to understand their tasks and data, and convert enterprise data into scalable environments.
- Build systems for grading agent performance, mining tasks and evaluation cases, and testing learning objectives.
- Develop replay and observability systems, and optimize models, tools, context, and policies for performance and inference cost.
What they ask for
- Experience building production-grade software (internships are OK) or working in a quant role.
- Strong software skills and ability to build systems that process large, messy datasets at scale.
- Strong intuition for systems, abstraction, and data structures.
- Ability to turn fuzzy business objectives into reliably evaluable tasks and signals.
Pay
$140K – $175K USD base salary
Tools
reinforcement learning
AI focus
Improve model and agent performance using replayable historical enterprise environments, evaluation sets, reinforcement learning, and other post-training techniques.
Model-written summary · the original posting is authoritative