Epsilon Health
Research Engineer / Research Scientist, Vision-Language Model Pretraining
San Francisco, CA · On-site · Full-time · Posted Aug 31, 2026
- Experience
- No specific number of years stated.
About the job
Own research and pretraining of multimodal vision-language foundation models that interpret medical images and generate clinically accurate radiology reports.
What you'll do
- Design, pretrain, and scale models, architectures, and training methods for medical imaging.
- Lead research from experiment design through distributed training and evaluation, then hand off models to post-training.
- Develop evaluations for visual understanding, grounding, generalization, and downstream performance; publish research findings.
What they ask for
- Deep expertise in vision-language models, multimodal learning, or large-scale foundation model pretraining.
- Demonstrated ability to develop, train, or improve state-of-the-art machine learning models; strong understanding of VLM architectures, training objectives, and alignment.
- Experience with large-scale distributed training using PyTorch or JAX.
- Ability to independently formulate research questions and experiments, with strong engineering skills implementing and extending research ideas.
Nice to have
- Publications at leading ML or computer vision conferences, or experience developing/scaling models such as LLaVA, Qwen-VL, or InternVL.
- Experience in high-resolution imaging, visual grounding, 3D/volumetric data, multimodal data curation, or medical/scientific imaging.
Tools
PyTorch, JAX, LLaVA, Qwen-VL, InternVL
AI focus
Pretraining multimodal vision-language foundation models for medical-image understanding, visual grounding, and radiology report generation.
Model-written summary · the original posting is authoritative