2027 Summer Intern, PhD, Research, RSI for Autonomous Driving

What you'll do

• Research state-of-the-art work and connect it to research projects to improve driver quality.
• Design data and post-training recipes for closed-loop reinforcement learning with critic and world models; implement the RSI system.
• Inspect training results and ablation studies to refine algorithm design.

What they ask for

• Currently pursuing a PhD in Computer Science, Robotics, Machine Learning, or a related quantitative field.
• Depth in foundational AI model post-training, especially RL.
• Fluency with AI coding agents and one RL training framework, such as Rex, Verl, or NeMo-RL.
• Fluency in AI model training basics, including transformer architecture, hyperparameter tuning, and overfitting debugging.

Nice to have

• Depth in RL for robotics or autonomous driving models, or in world action models or video generation models.
• Experience in Recursive Self-Improvement training for AI models.

Pay

$85 USD/hour (base pay)

Tools

Rex, Verl, NeMo-RL

AI focus

AI research and development involving reinforcement learning, recursive self-improvement, critic and world models, and autonomous driving foundation models.