Arena
Software Engineer - Data Infrastructure
$150K–$350K
SF Bay Area · On-site · Full-time · Posted Dec 18, 2025
- Experience
- 5+ years in software engineering, with a dedicated focus on data engineering and big data technologies.
About the job
Build and scale data pipelines and infrastructure that process user votes and support real-world evaluation of AI model performance.
What you'll do
- Design, build, and maintain pipelines that ingest, process, and transform user vote data for model evaluation.
- Work with researchers and product leadership to identify data needs and create result dashboards and reports.
- Maintain pipeline integrity, data quality, and reliability while scaling infrastructure for growing data volumes.
What they ask for
- Proficiency in SQL and at least one data-analysis programming language: Python, Scala, or R.
- Hands-on experience with data processing and pipeline frameworks such as Apache Spark or Ray Data, and with a big data analytics platform such as Databricks or Snowflake.
- Demonstrated experience designing, implementing, optimizing, and debugging production data pipelines.
Nice to have
- Prior work with data analytics or datalake platforms; experience with Delta lake or streaming tables.
- Exposure to machine learning.
Pay
$150K – $350K (currency not stated; base salary or total pay not stated)
Tools
SQL, Python, Scala, R, Apache Spark, Ray Data, Databricks, Snowflake
AI focus
Build data infrastructure for evaluating AI model performance and comparing frontier models using human votes and feedback.
Model-written summary · the original posting is authoritative