Tech Stack
Tag name is followed by "@" symbol and proficiency level value.
About proficiency levels:
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
AI @ 4
CUDA
Cloud Computing
Distributed Systems
ETL
GPU
JSON
Java @ 6
Parquet
Presto @ 3
Scala @ 6
Software Development @ 7
Spark @ 3
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Details
NVIDIA is seeking a Senior Systems Software Engineer for the Apache Spark Acceleration group. GPU-accelerated data processing has moved from proof of concept to production deployments, and multi-node GPU deployments can reduce cloud computing costs and lower latency in batch ETL workloads. The team is developing an open-source plugin to accelerate Apache Spark applications on GPUs without code changes.
Responsibilities
- Enable C++ native execution of Spark operations on CUDA.
- Develop CUDA/C++ libraries to accelerate DataFrames and I/O operations on common file formats such as Parquet, ORC, and JSON.
- Collaborate with distributed systems teams to develop solutions to distributed processing challenges at large scale.
- Work with open-source communities to enhance libraries such as RAPIDS, CCCL, and UCX through technical discussions and code contributions.
- Provide recommendations and feedback to teams on infrastructure, continuous integration, and testing strategy.
- Build, test, and optimize software across different platforms.
Requirements
- 9+ years of experience in software development.
- 5+ years of hands-on experience with data platform development.
- Bachelor’s, master’s, or doctoral degree in computer science or a related field, or equivalent experience.
- Proficiency in C++, Java, and Scala.
- Experience supporting enterprise customers.
- Familiarity with the open-source data platform ecosystem is a plus, including Apache Spark, Velox, Presto, Apache Arrow, and Apache DataFusion.
- Experience using AI tools in software development.
Compensation and Benefits
The base salary range is $184,000–$287,500 USD for Level 4 and $224,000–$356,500 USD for Level 5. Salary is determined based on location, experience, and the pay of employees in similar positions. The role is also eligible for equity and benefits.
More jobs at Nvidia
Senior Math Libraries Engineer - LLM Integration and Developer Experience
Nvidia · Santa Clara, United States
USD 152,000-287,500 per year
Senior Software Architect, Networking AI
Nvidia · Santa Clara, United States
USD 184,000-356,500 per year
Manager, CUDA Driver
Nvidia · Santa Clara, United States
USD 224,000-431,200 per year
Custom SoC IP Verification Engineer
Nvidia · Santa Clara, United States
USD 168,000-310,500 per year
Research Intern, Fundamental Generative AI - 2027
Nvidia · Santa Clara, United States
USD 38-94 per hour
Similar jobs
Principal Systems Software Engineer
Nvidia · Santa Clara, United States
USD 272,000-431,200 per year
Senior Machine Learning Engineer, Accelerated Apache Spark
Nvidia · Santa Clara, United States
USD 224,000-356,500 per year
Senior System Software Engineer, ML and Vector Search
Nvidia · Santa Clara, United States
USD 184,000-287,500 per year
Staff Software Engineer, Data Quality and Governance
Stripe · Canada, Toronto, Canada, South San Francisco, United States, Seattle, United States
USD 224,000-336,000 per year
Data Engineer, Core Experimentation
OpenAI · Bellevue, United States, Seattle, United States
USD 293,000-325,000 per year
Staff Software Engineer - Ingestion Platform
Reddit · United States
USD 217,000-303,900 per year
Principal Site Reliability Engineer
Nvidia · Santa Clara, United States
USD 248,000-396,800 per year
Senior Systems Software Engineer – GeForce NOW Cloud
Nvidia · Santa Clara, United States
USD 224,000-356,500 per year