Senior Systems Software Engineer, TAO Machine Learning Data Modeling

Details

NVIDIA is hiring a Senior Systems Software Engineer for machine learning data modeling to join the TAO Toolkit ML Data and Platforms Team. Our team builds frameworks, services, algorithms, and tools that power the largest NVIDIA Multi-Modal Foundation Models and their customization. In this role, you will develop novel algorithms to make automated sense of petabytes of unstructured data using machine and deep learning algorithms, in collaboration with multiple deep learning architects and engineers to enable the development of pioneering AI models.

Responsibilities

• Help in finding the right data for a Multi-Modal model with scalable systems. Design and develop an active (and passive) learning paradigm within (and out) of the loop annotators to iteratively mine informative data.
• Design various (ML and DL) architectures and loss functions to ingeniously formulate automated pseudo-labeling for various multi-modal tasks.
• Design insightful metrics (in settings: unsupervised, semi-and-supervised) for performance characterization of various models and data.
• Build scalable and robust ETL pipelines using novel and meaningful ML and DL models to deliver high-quality datasets.
• Work with internal teams to define requirements, enhance products, and automate workflows.

Requirements

• Bachelor's degree (or equivalent experience) in Computer Engineering, Computer Science, Electrical Engineering, Robotics, or related field.
• 5+ years of ML / DL-related engineering experience with strong architecture and design skills.
• Excellent background and understanding of the deep roots of Machine Learning and Deep Learning.
• Expertise with an understanding of out-of-distribution and related concepts.
• Knowledge of PyTorch, distributed machine learning, and distributed file systems.
• 3+ years leading complex sometimes ambiguous projects, particularly in high-throughput services at supercomputing scale.
• Experience with Dagster, Terraform.
• Experience in high-performance computing environments and workflow automation frameworks (e.g., Airflow).

Ways to stand out from the crowd

• Proficient in running applications on cloud platforms using Kubernetes and Docker, and ML frameworks like Pytorch.
• Proficient in building systems and familiar with deep learning architectures and tools like NVIDIA TensorRT-LLM, Multimodal-LLM, and Triton Server.
• Familiar with GPU programming concepts, and writing custom CUDA kernels.
• Experience with SQL databases and cloud infrastructure (AWS, GCP, Kubernetes).

With a competitive salary package and benefits, NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. Are you a creative and autonomous Senior Software Engineer, who loves challenges? Do you have a genuine passion for advancing the state of Machine and Deep Learning across a variety of industries? If so, we want to hear from you.