Crosby
Member of Technical Staff, AI Developer Experience
$200K–$360K
New York City · On-site · Staff · Full-time · Posted Jun 15, 2026
- Experience
- 3+ years of software engineering experience; developer tools, infrastructure, or platform experience is described as ideal.
About the job
Build internal AI developer tools and infrastructure that help Crosby’s teams develop, evaluate, and deploy AI features faster and more reliably.
What you'll do
- Build tools for prompt management, evaluation, experimentation, and model iteration; improve testing, debugging, and output comparison.
- Develop evaluation and monitoring infrastructure, including benchmarking and regression testing.
- Build data collection, labeling, and feedback workflows; help ensure production AI systems are reliable and maintainable.
What they ask for
- 3+ years of software engineering experience.
- Strong proficiency in Python and experience building backend systems and internal tooling.
- Hands-on experience with LLMs, APIs, and modern AI workflows.
- Experience building systems for experimentation, evaluation, or data pipelines.
Nice to have
- Experience working on developer tools, infrastructure, or platform teams.
Pay
$200K – $360K USD base salary
Tools
Python, OpenAI, Anthropic
AI focus
Build developer tooling and infrastructure for prompting, experimentation, evaluation, fine-tuning, deployment, and improving AI models and features.
Model-written summary · the original posting is authoritative