Senior Software Engineer, Agentic AI Applications

at Nvidia
📍 Santa Clara, United States
USD 136,000-264,500 per year
SENIOR
✅ On-site

SCRAPED

Used Tools & Technologies

Not specified

Required Skills & Competences ?

Go @ 4 Kafka @ 6 Python @ 6 Data Science @ 4 Communication @ 6 LLM @ 4 CUDA @ 3 GPU @ 3

Details

NVIDIA is seeking a Senior Software Engineer to help build agentic blueprints and reference workflows, including the AI-Q deep researcher blueprint. This role focuses on crafting industry-leading agentic reference examples that teach the industry how to implement agentic AI in their own enterprises. The ideal candidate has a strong background in generative AI, ability to convert proof-of-concept applications into products, and a strong engineering background in creating production-ready code.

Responsibilities

  • Design, develop, and implement agentic AI blueprints (applications) that show enterprises how to utilize and deploy this technology.
  • Implement new features of GenAI SDKs enabling LLM agents for demanding use cases and larger deployment configurations.
  • Craft proof-of-concept workflows using modern data science techniques for GenAI use cases.
  • Collaborate with engineers to optimize agentic applications for accuracy, latency, and efficiency across data centers.
  • Build integrations between the AIQ toolkit and other NVIDIA products such as NeMo Framework, NIMs, and NVIDIA Blueprints.
  • Work with data scientists and ML/DL engineers to move from proof-of-concept to production-ready pipelines and deployments.

Requirements

  • BS in Computer Engineering, Computer Science, Data Science, or related field (or equivalent experience).
  • Proficient in Python with 5+ years of experience building Python libraries/applications for enterprise customers.
  • Experience with GenAI application development using LLM frameworks (e.g., Langchain, Llamaindex, AutoGen), evaluation systems (e.g., RAGAs), and observability platforms (e.g., Arize Phoenix, W&B Weave, LangSmith).
  • Experience using and understanding agentic frameworks.
  • Proficient in distributed orchestration and communication frameworks (e.g., Kafka, Ray).
  • Ability to quickly learn and apply new technologies and libraries.
  • Self-starter with proactive work ethic, able to work independently and in distributed teams.
  • Strong collaboration skills essential for distributed multifunctional teams.

Ways to Stand Out

  • MS, PhD, or equivalent experience in Computer Engineering, Computer Science, Data Science, or related quantitative field.
  • Experience developing agents in Python or similar languages (e.g., Go).
  • Demonstrated ability to profile code and mitigate performance bottlenecks.
  • Experience developing for GPU platforms and familiarity with NVIDIA technologies (CUDA, TensorRT, Triton, NeMo) and LLM serving frameworks (Dynamo, vLLM, SGLang).
  • Experience with RAG systems and communication protocols (MCP, A2A).

Widely considered one of the most desirable employers, NVIDIA offers highly competitive salaries and comprehensive benefits. Base salary will be determined based on location, experience, and peer pay.

For more benefits information: www.nvidiabenefits.com

NVIDIA is an equal opportunity employer committed to diversity.