NVIDIA
Software Engineer, Performance Instrumentation
$168K–$270K
US, CA, Santa Clara +1 · Full-time · Posted Oct 29, 2026
- Location
- US, CA, Santa Clara
US, TX, Austin - Experience
- 8+ years of relevant software engineering experience, including hands-on instrumentation or tracing in production machine learning or systems software.
- Education
- Bachelor’s degree in Computer Science, Computer Engineering, or a related field, or equivalent experience.
About the job
Defines performance data requirements and develops reliable, low-overhead instrumentation and data-quality measures for diagnosing performance across machine-learning and systems software.
What you'll do
- Define performance data requirements, identify visibility gaps, and work with partner teams to address them.
- Guide low-overhead instrumentation and annotation APIs, while measuring their effects on real workloads.
- Implement data-ingestion validation, sanitization, checks, and alerts; coordinate delivery across teams.
What they ask for
- Bachelor’s degree in Computer Science, Computer Engineering, or a related field, or equivalent experience.
- 8+ years of relevant software engineering experience, including hands-on instrumentation or tracing in production machine learning or systems software.
- Proficiency in CUDA, Python, and C++; working knowledge of PyTorch or JAX and annotation or tracing APIs such as NVTX.
- Experience maintaining data quality in a pipeline and measuring instrumentation overhead and trade-offs.
Nice to have
- Experience establishing telemetry conventions or schemas adopted by other teams; background in storage, checkpointing, or data-loading performance.
- Expertise in low-overhead event collection or familiarity with network and collective-communication telemetry, including NCCL, NICs, and fabric counters.
Pay
168,000 USD - 270,250 USD (base salary)
Tools
CUDA, PyTorch, JAX, NVTX, Python, C++, NCCL, NICs
Model-written summary · the original posting is authoritative