Ro
Senior Engineer, Applied AI
$191K–$234K
New York, NY · Hybrid · Senior · Full-time · Posted Jun 27, 2026
- Experience
- 5+ years building production software, including at least 1–2 years building and deploying LLM-powered applications in production; equivalent depth through substantial side projects or open-source work is accepted.
About the job
Build and operate LLM-powered features and infrastructure for patient experiences, clinical operations, and internal tools, from prototype through production.
What you'll do
- Design and ship LLM features, including orchestration, retrieval, agent workflows, and structured outputs.
- Develop evaluation, observability, safety, and reliability systems for production AI.
- Work with clinical and operational teams to identify workflows to automate, then prototype, measure, and iterate.
What they ask for
- Strong Python engineering skills and experience building backend services and integrating modern AI APIs and frameworks.
- Experience shipping AI features for real users and explaining how quality, reliability, latency, cost, and business impact were measured.
- Comfort using AI-assisted development tools throughout the software development lifecycle.
- Strong product instincts and ability to translate ambiguous operational problems into technical solutions.
Nice to have
- Experience with orchestration frameworks, RAG architectures, vector databases, and prompt/version management.
- Experience with evaluation or observability platforms such as LangSmith, Braintrust, or Arize Phoenix.
Pay
$190,800 to $234,500 USD base salary
Tools
Python, LangChain, LangGraph, AgentCore, LangSmith, Braintrust, Arize Phoenix
AI focus
Build production LLM applications and their orchestration, retrieval, evaluation, observability, safety, and reliability systems for healthcare workflows.
Model-written summary · the original posting is authoritative