Product Manager, Agent Intelligence

What you'll do

• Define agent quality standards and evaluation rubrics across workflows and customers.
• Build evaluation systems, including human review, automated pipelines, and scenario-based testing.
• Analyze conversations and close the feedback loop by translating failures into tests and product improvements.

What they ask for

• Experience as a Product Manager, ideally on technical, data-intensive, AI, automation, or platform products.
• Strong analytical skills and comfort with data, metrics, and ambiguous problem spaces.
• Ability to define quality standards, measurement frameworks, evaluation processes, or operational workflows.
• Experience working closely with engineering and cross-functional teams.

Nice to have

• Experience with AI products, conversational interfaces, LLMs, machine learning workflows, or agent systems.
• Experience with evaluation frameworks, experimentation, quality operations, or human-in-the-loop systems.

Pay

$150K – $185K USD base salary

AI focus

Builds systems to evaluate and improve AI agent performance, including conversational data analysis, automated evaluation, retrieval, ranking, personalization, and feedback systems.