Collinear AI
MTS - Engineering (Data Infrastructure)
San Francisco, CA +1 · On-site · Full-time · Posted Oct 1, 2026
- Location
- San Francisco, CA
Sunnyvale, California - Experience
- 5+ years of experience building data-intensive systems in production.
About the job
Build and scale data infrastructure that processes, links, searches, transforms, and quality-checks large, heterogeneous datasets for downstream use.
What you'll do
- Build parallel pipelines for multi-terabyte datasets, including archives, spreadsheets, email, PDFs, and scanned documents.
- Design graph-based record-linking systems and fast string and pattern search across large datasets.
- Improve processing performance, transform sensitive data, and define data-quality measures and review tools.
What they ask for
- 5+ years of experience building data-intensive systems in production.
- Experience processing large datasets in parallel using frameworks such as Apache Spark, Ray, or Dask, or designing custom approaches.
- Strong command of graph algorithms and experience applying them to transform large amounts of data.
- Experience building efficient string matching and pattern search at scale.
Nice to have
- Experience with entity resolution or record linkage; NLP or LLM-based information extraction; or OCR and document processing.
- Experience with Rust, C++, or Go, or with regulated or sensitive data.
Tools
Apache Spark, Ray, Dask, NLP, LLM, OCR, Rust, C++
AI focus
NLP or LLM-based information extraction is listed as a nice-to-have; the role otherwise focuses on data infrastructure.
Model-written summary · the original posting is authoritative