Applied Researcher, Vision Language Models/VLM - TikTok

What you'll do

• Lead and conduct research on multimodal reasoning and generation.
• Enhance VLMs with features such as OCR and captioning, and explore efficient model architectures and inference designs.
• Collaborate with cross-functional teams to implement VLM projects for business applications and share research insights with academia.

What they ask for

• Ph.D. in Computer Science, Data Science, Artificial Intelligence, or a related field.
• Strong understanding of cutting-edge LLM research.
• Proficiency in Python, Rust, or C++, and experience with deep learning frameworks.

Nice to have

• Experience with inference tuning or acceleration, AI accelerators, large-scale AI networks, or evaluation and agent development.
• Published research or familiarity with distributed computing, performance tuning, PEFT, RL, MoE, CoT, or Langchain.

Tools

Python, Rust, C++, pytorch, deepspeed, megatron, vllm, Langchain

AI focus

Research and development of LLMs, VLMs, and multimodal models, including pretraining and post-training, reinforcement-learning-based alignment, evaluation, data processing, efficient training and inference, and downstream applications.