Agent Evaluation & Evolution Machine Learning Engineer Intern (AML-Ark-US) - 2027 Summer

What you'll do

• Design agent evaluation systems for task success, tool use, reasoning quality, and reliability; build benchmarks and automated judging pipelines.
• Analyze agent execution traces and user feedback to identify failure patterns and recommend improvements.
• Work with research, platform, and product teams to move evaluation methods into production.

What they ask for

• Currently pursuing a bachelor's degree in Computer Science, Artificial Intelligence, Machine Learning, Data Science, or a related field.
• Solid foundation in machine learning and deep learning.
• Hands-on experience with LLM-based systems through research, internships, or projects.
• Strong Python skills, experience with a mainstream ML or agent evaluation framework, and demonstrated research or engineering ability.

Nice to have

• Publications at top-tier ML/NLP venues, especially in agent learning, self-improving/self-evolving/RSI, or agent evaluation.
• Experience with evaluation methodology, LLM post-training, reasoning and planning, continual learning, feedback-driven optimization, or large-scale log and trace analysis.

Tools

Python, LLM, ML

AI focus

Evaluates LLM-based agents, builds benchmarks and automated judging pipelines, analyzes agent behavior and feedback, and supports feedback-driven capability improvement.