FriendliAI
Software Engineer – AI Agents
San Francisco · Hybrid · Full-time · Posted Apr 15, 2026
- Experience
- 3+ years of software engineering experience, preferably in backend, ML systems, or API development.
- Education
- Bachelor’s or Master's degree in Computer Science, Computer Engineering, or equivalent.
About the job
Designs and builds agent APIs and production-ready applications for document understanding and other AI workflows, integrating models into FriendliAI’s platform.
What you'll do
- Build and maintain agent APIs and applications, including reference implementations for customers.
- Evaluate and integrate open-source models into production agent features.
- Integrate agents with deployment, orchestration, and monitoring systems, and improve production reliability, scalability, and performance.
What they ask for
- Strong Python programming skills and experience with Python frameworks.
- Solid understanding of LLM workflows, agent patterns, or tool invocation systems.
- Experience designing and delivering production APIs.
- Strong foundations in cloud-native development.
Nice to have
- Experience with document understanding pipelines such as OCR, RAG, summarization, or structured extraction.
- Familiarity with Kubernetes or container orchestration in production.
Tools
Python, HuggingFace, LangChain, LlamaIndex, Kubernetes
AI focus
Builds agentic features and applications, including document understanding, advanced RAG, and customer support automation; evaluates and integrates open-source models.
Model-written summary · the original posting is authoritative