Research Scientist Intern - Multimodal Sensing & On-Device Perception - Global Frontier Tech Recruitment Program - 2027 Start (PHD)

What you'll do

• Design novel sensor or imaging architectures, including near-sensor processing, event-driven capture, or pixel-level learned compression.
• Build and characterize imaging pipelines from optics and sensors through ISP and perception models.
• Develop or adapt machine vision models for hardware constraints, using VLM, LLM, and world-model needs to guide sensing design.

What they ask for

• Currently pursuing a PhD in Computer Science, Electrical Engineering, Optical Engineering, Applied Mathematics, Physics, or a related technical field.
• Strong research background in computer vision and machine learning, with hands-on model training experience.
• Experience with at least one of: sequence modeling, language modeling, efficient neural network design, or signal processing.

Nice to have

• Research publications in CVPR, ICCV, ECCV, NeurIPS, ICLR, SIGGRAPH, or similar.
• Hands-on camera, structured-light, or active-sensing hardware prototyping; or familiarity with on-device/on-sensor compute, embedded ML, and hardware/software co-design.

Tools

VLM, LLM, ISP

AI focus

Co-design sensing hardware and machine vision algorithms for efficient on-device perception, informed by vision-language, language, and world models.