Software Engineer - Evaluation

What you'll do

• Develop algorithms, evaluation metrics, testing frameworks, and simulation environments for AI decision-making and business systems.
• Build scalable data pipelines, toolchains, and high-performance backend services for large-scale processing and real-time events.
• Improve production monitoring and LLM workflows, including model reasoning controls, guardrails, and hallucination mitigation.

What they ask for

• Strong programming skills in C/C++, Python, and software design.
• Strong foundation in mathematics and theoretical computer science.
• Engineering discipline or strong interest and potential in building large-scale systems while optimizing performance, complexity, and cost.
• BS/MS or Ph.D in Computer Science or a related field.

Pay

$120,000 - $200,000 USD annually (base salary)

Tools

C/C++, Python, Large Language Models (LLMs)

AI focus

Develop evaluation algorithms and metrics for AI decision-making, and engineer LLM workflows with reasoning controls, guardrails, and hallucination mitigation.