Lilt
Project Manager, Applied AI
$104K–$163K
USA · Remote · Manager · Full-time · Posted Sep 21, 2026
- Experience
- 3–5+ years of project management experience in AI/ML data operations.
About the job
Leads multilingual AI data collection and LLM evaluation projects, coordinating global annotator teams and monitoring delivery, quality, and performance.
What you'll do
- Manage AI data projects from scoping and guideline creation through delivery and post-project analysis; oversee multilingual data and LLM evaluation pipelines.
- Track project KPIs, run quality-control and corrective-training loops, and maintain dashboards to identify bottlenecks.
- Coordinate data experts, crowd pools, and Applied AI Technical Ops, translating technical needs into clear annotation guidelines.
What they ask for
- 3–5+ years of project management experience specifically in AI/ML data operations.
- Strong understanding of LLM training processes (Pre-training, SFT, RLHF) and evaluation methods, including human-in-the-loop and red teaming.
- Advanced Excel/Google Sheets proficiency and ability to write SQL queries to analyze performance data.
- Proven experience using Agile, Scrum, or Kanban; ability to write clear guidelines for multilingual audiences.
Nice to have
- Fluency in a second language; experience with data annotation platforms (e.g. Scale AI, Super Annotate) or project management tools (e.g. Jira).
- Background in ML Engineering, Computer Science, or Data Science, and project management training.
Pay
$104K – $163K (base salary; compensation type not specified in posting)
Tools
Excel, Google Sheets, SQL, Scale AI, Super Annotate, Jira
AI focus
Operationally manages multilingual AI data collection and LLM evaluation, including RLHF, SFT, ranking, and safety testing; data insights inform annotation guidelines and model fine-tuning strategies.
Model-written summary · the original posting is authoritative