Software Engineer, Data Systems

at Nvidia
USD 224,000-356,500 per year
SENIOR
✅ On-site

Tech Stack

AI API ClickHouse @ 4 Communication @ 6 Data Pipelines @ 4 GPU Parquet @ 4 Profiling Python @ 6 SQL @ 6

Details

NVIDIA is seeking a Software Engineer, Data Systems to join its Santa Clara, California team. The role involves building advanced software tools for analyzing AI workload performance across GPU data centers. You will manage the store, data model, and query path, converting large streams of profiling and telemetry data into useful information for engineers and automated analysis.

Responsibilities

  • Develop and construct the store, data model, and query path for engineering performance data, including ingesting, joining, storing, and delivering data at GPU data center scale with low latency.
  • Join profiling data with system context such as hosts, schedulers, configuration, logs, and storage, ensuring each record has the identity and dimensions needed for comparisons across jobs, machines, versions, and time.
  • Establish and version data contracts with data-producing teams and transition consumers through changes without disruption.
  • Make deliberate trade-offs among data quality, query latency, storage cost, and retention, and measure improvements in efficiency, latency, and resource usage.
  • Handle delayed, duplicated, incomplete, or inconsistent data and make its limitations visible to downstream users.
  • Develop the data API and generated evidence views for human and automated analysis.
  • Implement access controls and resource limits and maintain stable behavior during high demand or failures.

Requirements

  • Bachelor's degree in Computer Science, Computer Engineering, or a related field, or equivalent experience.
  • 12 or more years of relevant software engineering experience, including delivering and operating data pipelines, storage systems, analytical services, or comparable software used by others.
  • Experience handling large-scale production data, including billions of events per day or petabyte-class stores.
  • Experience with low-latency streaming pipelines that manage backpressure, replay, and duplicate delivery accurately.
  • Good judgment regarding event identity and ordering, data transformations, and the impact of errors or missing data on results.
  • Ability to explain a concrete performance investigation, including the baseline, measurements, competing explanations, changes made, verified results, and trade-offs.
  • Experience establishing and versioning data contracts with producing teams and guiding consumers through format changes.
  • Ability to debug across component boundaries and validate changes through code review, testing, and independent measurements, including when using automated development tools.
  • Clear communication about technical choices, observed behavior, uncertainty, user data, and operational constraints.
  • Proficiency with C++, Python, and SQL.

Preferred Qualifications

  • Hands-on experience with telemetry, time-series data, or analytical query engines such as ClickHouse.
  • Experience with columnar formats such as Arrow and Parquet.
  • Familiarity with profiler data, including trace record formats, sampling semantics, symbolization, clock domains, and aligning events recorded on different machines.
  • Experience building high-cardinality schemas and improving memory use, storage efficiency, or query performance while preserving correctness.
  • Track record of making data processing easier to inspect and recover when inputs change, traffic spikes, or failures occur.
  • Working knowledge of Go.

Compensation and Benefits

  • Base salary range: $224,000–$356,500 USD per year, determined by location, experience, and the pay of employees in similar positions.
  • Eligible for equity and benefits.
  • Applications will be accepted at least until November 2, 2026.
  • NVIDIA uses AI tools in its recruiting processes.
  • NVIDIA is an equal opportunity employer committed to an inclusive work environment.

More jobs at Nvidia

Similar jobs