Software Engineer, AI Infrastructure, Core
Austin, TX, USA +1 · Full-time · Posted Oct 13, 2026
- Location
- Austin, TX, USA
New York, NY, USA - Experience
- 5 years in Java software development; 3 years testing, maintaining, or launching software products; 1 year in software design and architecture; 1 year with GenAI techniques or concepts.
- Education
- Bachelor’s degree or equivalent practical experience.
About the job
Designs and deploys AI infrastructure for agentic applications, including orchestration, model serving, evaluation, and observability systems.
What you'll do
- Build production-grade multi-agent workflows, tool-use orchestration, and dynamic decision-making pipelines.
- Develop high-throughput model-serving pipelines and real-time execution environments for latency, reliability, and scale.
- Create automated testing, continuous evaluation, observability, tracing, and telemetry for generative AI workflows.
What they ask for
- Bachelor’s degree or equivalent practical experience.
- 5 years of experience with software development in Java.
- 3 years of experience testing, maintaining, or launching software products, and 1 year of experience with software design and architecture.
- 1 year of experience with GenAI techniques or related concepts, and experience in machine learning infrastructure.
Nice to have
- Master's degree or PhD in Computer Science or a related technical field; 1 year experience in machine learning, generative AI and AI algorithms.
- 1 year of experience in a technical leadership role.
Pay
$174000 - $252000 USD base salary
Tools
Java, LLMs, Multi-Modal, Large Vision Models, OpenTelemetry
AI focus
Builds and operates agentic AI workflows, generative AI infrastructure, model-serving systems, and evaluation and safety frameworks.
Model-written summary · the original posting is authoritative