Syllo
Senior Software Engineer, Applied AI
$160K–$200K
Remote +1 · Remote · Senior · Full-time · Posted Sep 15, 2026
- Location
- Remote
United States - Experience
- No years specified; commercial AI product experience required.
About the job
Build and maintain scalable, user-facing AI features for Syllo’s litigation platform, integrating LLMs with production systems and business workflows.
What you'll do
- Design, build, test, and monitor reliable AI-powered features and services across their full lifecycle.
- Improve LLM reliability and service performance through guardrails, validation, fallbacks, evaluation, and optimization of latency, throughput, and cost.
- Integrate models and data feeds with APIs and business logic, and strengthen existing data and feature pipelines.
What they ask for
- Fluent in Python and its ecosystem for backend services and data processing.
- Strong system design expertise, including distributed systems and API design.
- Commercial experience building, shipping, and maintaining AI-powered products, agents, or intelligent features.
- Hands-on production LLM integration experience, including prompt engineering, vector databases, RAG systems, and context windows.
Nice to have
- Experience fine-tuning or distilling task-specific models; familiarity with agent frameworks and their failure modes.
- Familiarity with AWS, GCP, or Azure, and Docker or Kubernetes.
Pay
$160,000 — $200,000 USD (base salary)
Tools
Python, Large Language Models (LLMs), vector databases, RAG systems, AWS, GCP, Azure, Docker
AI focus
Production engineering for LLM-powered litigation features, including reliability, evaluation, and performance; the role is not primarily research-focused.
Model-written summary · the original posting is authoritative