FriendliAI
Software Engineer - Senior Backend
San Francisco · Hybrid · Senior · Full-time · Posted Apr 15, 2026
- Experience
- 5+ years of backend or systems engineering experience in production environments.
- Education
- Bachelor's or Master's degree in Computer Science, Computer Engineering, or equivalent.
About the job
Own and evolve backend services and APIs for FriendliAI’s AI inference platform, including enterprise SaaS capabilities, data systems, and deployment workflows.
What you'll do
- Build and operate backend microservices and production APIs for AI deployments and enterprise workflows.
- Develop platform features such as authentication, RBAC, billing, multi-tenant infrastructure, and LLM deployment integrations.
- Optimize data models and pipelines, reliability, and performance; collaborate on multi-cloud orchestration and engineering quality.
What they ask for
- 5+ years of backend or systems engineering experience in production environments.
- Bachelor's or Master's degree in Computer Science, Computer Engineering, or equivalent.
- Expertise in Python and modern frameworks; experience with distributed systems, API design, SQL, PostgreSQL, and OLAP systems.
- Working knowledge of LLM serving and experience building secure, multi-tenant SaaS architectures.
Nice to have
- Hands-on experience with AI or model serving infrastructure.
- Experience with Kubernetes for production container orchestration and scaling.
Tools
Python, FastAPI, REST, gRPC, GraphQL, PostgreSQL, ClickHouse, OpenTelemetry
AI focus
Develop AI-specific platform features, including LLM deployment workflows and inference-specific service integrations; working knowledge of LLM serving is required.
Model-written summary · the original posting is authoritative