Morgan Stanley
Conversational AI Specialist, Vice President
$110K–$140K
Purchase, New York · On-site · Director · Full-time · Posted Oct 19, 2026
About the job
Develops conversational AI solutions for employee and client virtual assistants, including prompt design, model evaluation, optimization, and stakeholder coordination.
What you'll do
- Design and maintain conversational experiences and context-aware prompts for business use cases.
- Create and manage evaluations of generative AI outputs, including human and automated methods; troubleshoot and optimize model results.
- Coordinate with business, technology, vendor, and AI teams; manage project risks and monitor performance metrics.
What they ask for
- Experience in conversational AI solutioning, product development, experimentation, or innovation.
- Experience with prompt engineering using commercial or open-source LLMs.
- Experience with conversational AI evaluation techniques such as F1, RAGAS, and human feedback analysis.
- Strong AI knowledge, communication and leadership skills, and proven program or project management experience.
Pay
$110,000 and $140,000 per year (base salary)
Tools
GPT, Claude, Gemini, LLAMA, F1, RAGAS, LLM-as-a-judge
AI focus
Build and refine generative AI assistants and prompts, evaluate model quality and risks, and improve reliable AI outputs.
Model-written summary · the original posting is authoritative