Vals AI
Member of Technical Staff - Platform
$130K–$185K
San Francisco · On-site · Staff · Full-time · Posted Jun 27, 2026
- Experience
- No specific number of years stated.
About the job
Build and operate the platform and infrastructure used to run LLM benchmarks reliably and at scale.
What you'll do
- Build distributed evaluation systems and deploy cloud infrastructure, pipelines, and monitoring.
- Develop and maintain platform features and libraries across the React/TypeScript frontend and Python/Django backend.
- Review code and architecture, establish engineering practices, and collaborate with research teams.
What they ask for
- Strong engineering fundamentals and a track record of building and shipping substantial projects.
- Significant Python experience, especially professionally.
- Familiarity with system design concepts such as VMs, containerization, load balancers, and databases.
- Experience with LLM APIs and concepts such as temperature, tokenization, and reasoning.
Nice to have
- Frontend experience, ideally React; experience with Django, FastAPI, or other Python-based HTTP servers.
- AWS infrastructure and IaC experience; startup experience or interest in AI/ML systems and evaluation.
Pay
$130K – $185K (base salary)
Tools
Python, React/TypeScript, Django, FastAPI, AWS, CDK, Git
AI focus
Build infrastructure for evaluating LLMs across models, benchmarks, and machines; work with LLM APIs and collaborate with researchers on evaluation needs.
Model-written summary · the original posting is authoritative