xAI
Software Engineer, Data Platform
$180K–$440K
Palo Alto, CA · Full-time · Posted Jul 29, 2025
About the job
Designs, builds, and operates distributed data infrastructure for large-scale data transport and processing across the company.
What you'll do
- Build high-throughput, low-latency data ingestion and transport systems, and scale multi-tenant Kafka infrastructure.
- Extend and tune Spark, Flink, and Trino for production pipelines; build interfaces, APIs, and pipelines for petabyte-scale data.
- Debug and optimize distributed systems for reliability and performance, collaborating with ML, product, and infrastructure teams.
What they ask for
- Production experience with Kafka, Flink, Spark, Trino, or Hadoop.
Nice to have
- Proficiency in Rust, Go, Scala, or similar systems languages.
- Expertise in distributed systems, stream processing, or large-scale data platforms; debugging, profiling, and performance optimization skills; experience shipping and maintaining critical infrastructure.
Pay
$180,000 - $440,000 USD (base salary)
Tools
Apache Kafka, HDFS, Spark, Flink, Trino, Rust, Go, Scala
AI focus
Supports real-time ML pipelines and data workflows powering ML workloads; no model development is specified.
Model-written summary · the original posting is authoritative