Senior AI Software Engineer

What you'll do

• Build APIs, microservices, data pipelines, and storage solutions for AI inference across cloud and edge.
• Develop an agent orchestration runtime supporting tool use, memory management, and multi-step reasoning across LLMs, APIs, and edge-connected systems.
• Implement security, reliability, logging, monitoring, and alerting for distributed AI systems.

What they ask for

• 5+ years of backend software development experience and strong proficiency in Java, C++, or Python.
• Proficiency integrating LLMs into multi-agent systems, including agent orchestration, tool use, and memory/context management.
• Experience building distributed systems, microservices, and cloud-native applications.
• Knowledge of secure, privacy-aware interfaces; SQL and NoSQL databases; and data streaming technologies.

Nice to have

• Experience deploying AI models and integrating them into backend services.
• Knowledge of edge computing, networking, security best practices, cloud-edge hybrid architectures, or on-device AI frameworks.

Pay

$149,000 - $240,000 USD base salary

Tools

Java, C++, Python, LLMs, SQL, NoSQL, TensorFlow Lite, ONNX Runtime

AI focus

Builds backend services and agent orchestration for AI workloads across edge devices and cloud, including LLM integration, tool use, memory/context management, and real-time inference.