Senior Research Scientist (Multimodal Large Language Model) - PICO

What you'll do

• Develop and optimize MR-focused MLLMs, including multimodal alignment, data construction, evaluation, and training and inference acceleration.
• Build tool-use capabilities for MR, addressing spatial tools, multi-turn tasks, context memory, tool selection, and error correction.
• Translate research into product features in collaboration with software, product, and hardware teams.

What they ask for

• Master’s or Ph.D. in Computer Science, Electrical Engineering, Machine Learning, Artificial Intelligence, or a related quantitative field.
• Expertise in multimodal large-model training or cross-modal fusion, with hands-on model optimization and performance tuning.
• Research experience in LLM tool use, reinforcement learning, LLM agents, or interactive learning; understanding of single- and multi-turn interaction.
• Proficiency in Python and C++, experience with PyTorch or TensorFlow, and proficiency in core 2D/3D computer vision tasks.

Nice to have

• Relevant publications, or experience building large-scale MLLM pipelines, tool-use evaluation systems, or multimodal agent platforms.
• Familiarity with MR/AR/VR, spatial computing, 3D scene reconstruction, or long-horizon reasoning.

Tools

Python, C++, PyTorch, TensorFlow, 3DGS, NeRF

AI focus

Research and deployment of MR-focused multimodal large language models and tool-using agents, including multimodal scene understanding, spatial interaction, and long-horizon task execution.