Bedrock Robotics
Machine Learning Engineer: Evaluation
San Francisco, CA +1 · Hybrid · Full-time · Posted Jan 31, 2026
- Location
- San Francisco, CA
New York, NY - Experience
- 5+ years of professional software engineering, data science, or research experience; 2+ years analyzing modern ML or robotics system performance on real-world problems.
About the job
Build evaluation systems and metrics to assess real-world construction robotics performance and support Bedrock Operator development and deployment decisions.
What you'll do
- Build and maintain evaluation pipelines across simulation, hardware-in-the-loop systems, and field data.
- Develop metrics and data classifiers for training and evaluation datasets; use model-generated annotations to support iteration.
- Model and interpret system performance to identify site challenges and inform deployment readiness.
What they ask for
- 5+ years of professional software engineering, data science, or research experience; currently Senior or Staff level.
- 2+ years analyzing modern ML or robotics system performance on real-world problems.
- Proficiency in Python and a data warehouse query language, plus comfort developing on infrastructure within parallelized cloud-based frameworks.
- Strong statistical analysis skills and experience working with large datasets.
Nice to have
- Applied statistical background to ML research or real-world robotics applications.
Tools
Python
AI focus
Evaluate real-world ML and robotics systems; use models to annotate large datasets and support training, evaluation, and performance prediction.
Model-written summary · the original posting is authoritative