Senior Data Processing Platform Engineer

Details

Our technology has no boundaries! NVIDIA is creating the world’s most groundbreaking and innovative compute platforms for the world to use! It’s because of our work that data engineers and data scientists can advance their ideas. We are looking for individuals to develop a data processing and ML platform for data scientists to use.

Responsibilities

• Optimize distributed computing infrastructure by analyzing cost and right sizing for latency and performance
• Identify KPIs and instrument metrics tracking for dashboards and alerting
• Enhance and maintain a robust scale, reliable, real-time data processing service
• Train data engineers, data scientists and production engineers how to adopt data processing workflows
• Participate in on-call rotation, run-book implementation and continuous process improvement

Requirements

• Experience architecting, developing and deploying large-scale distributed systems at scale
• Strong Kubernetes experience on-premise and/or CSP, developing containerized microservices
• Hands on experience in the performance tuning/troubleshooting Spark applications
• Experience with distributed systems, databases, and big data systems like Ray, Spark Rapids
• Familiarity with metrics collection, health monitoring, and observability tools
• Building, operating and maintaining full stack software deployments coupled with excellent software programming skills
• Master's or Bachelor's degree in Computer Science or Electrical Engineering or CE or equivalent experience
• A minimum of 5 years experience with a background in software engineering and math

Ways to Stand Out

• Prior data processing at scale on Nvidia GPUs
• Experience with CUDA and/or using Nvidia GPUs for ML/DL

Benefits

Eligible for equity and benefits. NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. They do not discriminate based on race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.