Drimva

Phylo

Member of Technical Staff - Agent Engineer

$200K–$300K

South San Francisco · On-site · Staff · Full-time · Posted Jul 22, 2026

About the job

Build and improve production AI agent systems and evaluations for scientific discovery tasks.

What you'll do

  • Advance the agent harness through production implementation and experimentation with coordination, routing, memory, planning, and tool use.
  • Build evaluations of agent quality, reliability, latency, and cost; monitor production performance and turn findings into improvements.
  • Collaborate on infrastructure and new agent capabilities with scientists and engineers.

What they ask for

  • Strong software engineering experience building production backend systems, infrastructure, or distributed systems.
  • Research or production experience in machine learning or another quantitative discipline.
  • Familiarity with LLM APIs, tool calling, agent runtimes, or workflow orchestration.
  • Strong quantitative judgment and ability to move between research, analysis, system design, and production implementation.

Nice to have

  • Experience with LLM evaluations, human evaluation, model judges, replay testing, benchmark design, or experiment tracking.
  • Experience applying classical machine learning methods alongside LLMs in production systems.

Pay

$200K – $300K USD base salary

Tools

LLM APIs, Kubernetes

AI focus

Build and evaluate AI agents for biomedical and scientific discovery, including agent harnesses, multi-agent coordination, model routing, memory, planning, tool use, and production reliability.

Model-written summary · the original posting is authoritative

First seen Oct 29, 2026 · Last verified Nov 5, 2026 (UTC)