Qualitate
Senior Applied AI Engineer
$200K–$240K
New York City · Hybrid · Senior · Full-time · Posted Aug 19, 2026
- Experience
- 5+ years; ideally including time at a startup or other fast-paced environment.
About the job
Build and scale the LLM orchestration, retrieval, and production services behind Qualitate’s AI Moderator and its customer-facing research insights.
What you'll do
- Own real-time LLM orchestration for multi-turn expert interviews, including prompts, context, model routing, and latency.
- Build production APIs and services that turn interview data into structured, queryable insights; work with research, product, and data engineering.
- Instrument production AI evaluations, monitoring, and guardrails, and improve retrieval and generation quality.
What they ask for
- 5+ years building and shipping applied AI/ML systems in production.
- Hands-on LLM experience with prompt/system design, retrieval-augmented generation, tool/function calling, and structured outputs across model providers.
- Strong Python/TypeScript backend engineering experience designing and shipping APIs and microservices.
- Vector database and search expertise, including optimizing retrieval quality and latency at scale.
Nice to have
- Applied AI/ML experience at a technology startup; production experience with agentic or multi-turn conversational systems.
- Experience with AI evaluation frameworks, speech-to-text transcription, or ETL and unstructured-data pipelines.
Pay
$200K – $240K USD base salary; bonus amount not stated
Tools
Python, TypeScript, Anthropic, OpenAI, Deepgram, AssemblyAI, Whisper, MCP
AI focus
Develop production LLM and retrieval systems for AI-moderated expert interviews, including orchestration, evaluation, data processing, and insight generation.
Model-written summary · the original posting is authoritative