Principal Machine Learning Engineer, Accelerated Apache Spark

at Nvidia

USD 272,000-431,200 per year

SENIOR

✅ On-site

Tech Stack
Tag name is followed by "@" symbol and proficiency level value. About proficiency levels:

1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;

3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;

7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;

10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.

AI @ 7 Algorithms CUDA @ 3 Data Science @ 4 Deep Learning @ 8 ETL GPU GenAI Generative AI @ 7 Java @ 4 LLM Machine Learning @ 4 Pandas @ 4 PyTorch @ 4 Python @ 4 Reinforcement Learning @ 7 SQL Scala @ 4 Spark @ 4 TensorFlow @ 4 XGBoost @ 7 scikit-learn @ 4

Details

NVIDIA is looking for a Machine Learning Engineer to join the GPU-accelerated Apache Spark team. Apache Spark is a widely used data processing engine for large-scale ETL, SQL, and machine learning and deep learning model training and inference workloads. You will work with the open-source community to accelerate Apache Spark with GPUs and apply the latest machine learning and artificial intelligence methods to help enterprises migrate Spark workloads to GPUs at scale.

Responsibilities

Design and implement machine learning solutions for performance prediction and optimization of GPU-accelerated enterprise Apache Spark workloads.
Develop advanced algorithms and adaptive systems to continuously improve the performance of Apache Spark workloads on GPUs.
Develop AI-based agents and tools to assist with system issue resolution and application optimization.
Collaborate with key partners and customers on deploying complex machine learning solutions in various environments.
Maintain deep domain expertise in the latest advances in machine learning systems and algorithms.
Provide technical mentorship and leadership in data science and machine learning to a team of engineers.

Requirements

Bachelor's, master's, or doctoral degree, or equivalent experience, in Machine Learning, Data Science, Computer Science, or a closely related field.
12+ years of professional experience designing, implementing, and productionizing high-quality machine learning and deep learning solutions.
5+ years of experience as a technical lead in machine learning model development.
At least 2 years of hands-on experience with large-scale data processing platforms such as Apache Spark.
Ability to use modern tooling and sound techniques for crafting, deploying, and maintaining machine learning models.
Excellent Python programming skills and experience with Python data science libraries, including NumPy, pandas, scikit-learn, SciPy, PyTorch, and TensorFlow.
Deep experience with sophisticated machine learning methodologies, including large language models, generative AI, reinforcement learning, and adaptive online machine learning systems.
Strong expertise in feature engineering, feature importance assessment, and developing boosted tree model solutions such as XGBoost.

Preferred Qualifications

Understanding of the internal workings and architecture of Apache Spark.
Familiarity with NVIDIA GPUs and CUDA.
Experience coding in Scala, Java, and/or C++.

Compensation and Benefits

Base salary range: USD 272,000–431,250 per year.
Eligibility for equity and benefits.
Applications will be accepted at least until May 25, 2026.
NVIDIA is an equal opportunity employer committed to fostering a diverse work environment.