AlphaSense
Senior Engineering Manager, AI
$275K–$375K
Remote - United States · Remote · Manager · Full-time · Posted Aug 5, 2026
About the job
Leads the AI Platform team in building and operating AlphaSense’s high-throughput AI Gateway for routing and managing LLM traffic across the company.
What you'll do
- Manage, mentor, and grow a team of up to 10 senior and staff software engineers, and foster technical excellence and career growth.
- Own the AI Gateway’s strategy, architecture, and scaling, including routing, caching, queueing, availability, and fallback mechanisms.
- Guide integrations with LLM vendors and align the gateway roadmap, engineering standards, and cost-tracking telemetry with organizational goals.
What they ask for
- Track record of managing and growing high-performing teams of senior and staff engineers.
- Experience designing, building, and operating high-throughput, low-latency distributed systems, including complex routing, caching, queueing, or rate limiting.
- Ability to provide technical direction and feedback in architectural discussions and reviews.
- Exceptional communication and partnership skills across engineering, product, and executive stakeholders.
Nice to have
- Experience in applied AI or with LangChain, LangGraph, LiteLLM, or OpenRouter.
- Experience with Temporal, Envoy, Python, Java, or highly distributed caching/queueing systems.
Pay
$275,000 — $375,000 USD (base salary)
Tools
Large Language Model (LLM), LangChain, LangGraph, LiteLLM, OpenRouter, Temporal, Envoy, Python
AI focus
Leads an AI Gateway that routes and manages LLM traffic, coordinates integrations across vendors and models, and supports AI use in developer workflows.
Model-written summary · the original posting is authoritative