Lead Forward Deployed Engineer, AI Evaluation Platform

What you'll do

• Align Science, Platform Engineering, and Product Management on execution and roadmaps; integrate evaluation tools into partner workflows and promote self-service adoption.
• Gather developer needs and feedback, then use it to inform platform API quality, developer experience, and roadmap decisions.
• Translate research metrics and scoring algorithms into production services; create demos, tutorials, and reference implementations.

What they ask for

• Experience in a highly technical, cross-functional role such as Solutions Architecture, Forward-Deployed Engineering, Developer Advocacy, or Technical Program Management.
• Experience serving as a technical partner to internal customers and translating ambiguous requirements into engineering specifications.
• Functional understanding of machine-learning lifecycle and concepts, including datasets, training versus inference, and evaluation metrics.
• Experience partnering with applied scientists or researchers to operationalize scientific code.

Nice to have

• Familiarity with AI evaluation frameworks such as DeepEval, Ragas, TruLens, or LangSmith.
• Experience designing self-service research tools, serving as a strategic proxy for a technical organization, or bridging research and production engineering.

Pay

$175,000 and $263,300 USD base salary

Tools

DeepEval, Ragas, TruLens, LangSmith

AI focus

Build and drive adoption of AI evaluation systems for LLMs, agentic systems, and human-AI interaction; operationalize evaluation metrics and scoring algorithms as scalable production services.