Meta
Product Content Engineer
$162K–$227K
Los Angeles, CA +3 · Full-time · Posted Mar 19, 2026
- Location
- Los Angeles, CA
Menlo Park, CA
New York, NY
San Francisco, CA - Experience
- 5+ years of collaborative cross-functional experience; 1+ years working with generative AI products, AI evaluation, prompt engineering, annotation, and/or content labeling and analysis.
- Education
- BA or BS in Computer Science, Data Science, Linguistics, or related field.
About the job
Build and run evaluation frameworks for AI content experiences across Meta products, turning model assessments into actionable recommendations for product and engineering teams.
What you'll do
- Set content quality standards and evaluate AI model performance, including comparing releases and tracking regressions.
- Create evaluation rubrics, golden sets, taxonomies, guidelines, and workflows for collecting and analyzing AI outputs.
- Analyze evaluation results and collaborate cross-functionally to improve AI behaviors and content quality.
What they ask for
- 5+ years of experience working collaboratively with product, engineering, design, and user research teams.
- 1+ years working with generative AI products, AI evaluation, prompt engineering, annotation, and/or content labeling and analysis.
- Experience designing and implementing evaluation frameworks, annotation guidelines, or quality rubrics for AI/ML systems.
- BA or BS in Computer Science, Data Science, Linguistics, or related field.
Nice to have
- Familiarity with AI evaluation methods such as human eval, model-as-judge, A/B testing, or red-teaming.
- Experience with Python, SQL, or other tools for data analysis and evaluation automation.
Pay
$162,000/year to $227,000/year (base salary)
Tools
Python, SQL
AI focus
Evaluate and improve AI content experiences, model outputs, and AI behaviors using quality standards, structured evaluation methods, and responsible AI practices.
Model-written summary · the original posting is authoritative