Phylo
Member of Technical Staff - Agent Engineer
$200K–$300K
South San Francisco · On-site · Staff · Full-time · Posted Jul 22, 2026
About the job
Build and improve production AI agent systems and evaluations for scientific discovery tasks.
What you'll do
- Advance the agent harness through production implementation and experimentation with coordination, routing, memory, planning, and tool use.
- Build evaluations of agent quality, reliability, latency, and cost; monitor production performance and turn findings into improvements.
- Collaborate on infrastructure and new agent capabilities with scientists and engineers.
What they ask for
- Strong software engineering experience building production backend systems, infrastructure, or distributed systems.
- Research or production experience in machine learning or another quantitative discipline.
- Familiarity with LLM APIs, tool calling, agent runtimes, or workflow orchestration.
- Strong quantitative judgment and ability to move between research, analysis, system design, and production implementation.
Nice to have
- Experience with LLM evaluations, human evaluation, model judges, replay testing, benchmark design, or experiment tracking.
- Experience applying classical machine learning methods alongside LLMs in production systems.
Pay
$200K – $300K USD base salary
Tools
LLM APIs, Kubernetes
AI focus
Build and evaluate AI agents for biomedical and scientific discovery, including agent harnesses, multi-agent coordination, model routing, memory, planning, tool use, and production reliability.
Model-written summary · the original posting is authoritative