Goaly AI
Founding Senior Applied AI Engineer
Palo Alto, CA, USA · On-site · Senior · Full-time · Posted Sep 24, 2026
- Experience
- 5+ years building production software.
- Visa sponsorship
- H-1B and OPT/CPT support available, with immigration counsel.
About the job
Build and ship production agent harnesses and infrastructure, then use customer runs and failures to improve environments, evaluations, and models.
What you'll do
- Own agent harnesses, including agent loops, tools, prompts, permissions, retries, and output checks.
- Build sandboxed execution environments and observable, replayable evaluation systems for serving, RL, and evals.
- Work with customers to take workflows into production and turn traces and failures into tasks, environments, and reward signals for post-training.
What they ask for
- 5+ years building production software, with experience running systems at scale.
- Built and shipped an agentic system with tool use that real users depend on.
- Strong Python plus at least one of TypeScript, Go, or Rust; comfortable with Docker, Linux, and cloud infrastructure.
- Experience with agent failure modes and building evaluations.
Nice to have
- Experience with agent platforms, workflow systems, model-serving products, ML infrastructure, or developer-facing AI systems.
- Experience with multi-tenant control planes, enterprise security, high-throughput APIs, or open-source developer tools.
Tools
Python, TypeScript, Go, Rust, Docker, Linux, containers, microVMs
AI focus
Develop agent harnesses, sandboxes, context systems, and evaluations; deploy agents for customers and use production traces and failures to inform RL, post-training, and model improvement.
Model-written summary · the original posting is authoritative