Field Engineer, AI Labs

What you'll do

• Integrate model APIs and inference endpoints into evaluation harnesses; run benchmarks and analyze model performance and failure cases.
• Present evaluation findings to clients, respond to technical questions, and relay feedback to internal research and dataset teams.
• Curate, audit, validate, and package data deliveries to meet client specifications.

What they ask for

• 1 to 5 years of professional experience in data science, AI/ML engineering, solutions engineering, or data analytics, with a demonstrated transition into generative AI.
• Strong hands-on Python proficiency with REST/gRPC model APIs, inference endpoints, pandas, and SQL.
• Practical experience with model evaluation, benchmark design, or LLM-as-a-judge pipelines.
• Exceptional written and verbal communication, including explaining technical metrics to research scientists and on commercial calls.

Nice to have

• Experience at an early-stage AI startup or high-growth technology company across engineering and customer support.
• Experience with evaluation harnesses or agent benchmarks, model fine-tuning, open-weights models, multimodal evaluations, data quality control, task verification, or synthetic data generation.

Pay

$175,000 – $232,000 USD (base salary)

Tools

Python, REST/gRPC, OpenAI, Anthropic, Bedrock, vLLM, pandas, SQL

AI focus

Evaluates frontier AI models and benchmarks, identifies capability gaps and failure modes, and informs data requirements to improve model capabilities.