Axion Ray
Senior/Staff Software Engineer, AI Insights
$220K–$290K
San Francisco, CA +1 · Hybrid · Staff · Full-time · Posted Oct 8, 2026
- Location
- San Francisco, CA
New York, NY - Experience
- 5+ years building and operating production backend or data-intensive systems.
About the job
Leads backend engineering for AI Insights, building scalable agentic systems and data workflows that turn unstructured customer data into reliable structured outputs.
What you'll do
- Architect and operate multi-step, tool-using agentic pipelines; build evaluation frameworks and feedback loops to measure quality and catch regressions.
- Optimize model performance through prompting, pipeline design, model selection, and fine-tuning; own cloud-service reliability, observability, scalability, and on-call support.
- Mentor engineers and lead cross-team technical initiatives from design through production.
What they ask for
- 5+ years building and operating production backend or data-intensive systems.
- Production experience with LLM systems, including multi-step, tool-using, or agentic workflows.
- Experience measuring and improving model quality and designing distributed systems, asynchronous workflows, and reliable data-processing services.
- Experience with containerized applications on a major cloud platform (AWS/GCP/Azure); working knowledge of data warehousing.
Nice to have
- Fine-tuning or distillation experience (SFT, LoRA, or provider tuning APIs).
- Experience with LLM observability and cost/latency optimization.
Pay
$220K – $290K USD base salary
Tools
LLM, AWS, GCP, Azure, SFT, LoRA
AI focus
Build and operate agentic LLM pipelines; evaluate and improve model quality through prompting, pipeline optimization, model selection, and fine-tuning.
Model-written summary · the original posting is authoritative