Senior AI Infrastructure Software Engineer

at Nvidia
📍 Santa Clara, United States
USD 184,000-356,500 per year
SENIOR
✅ On-site

SCRAPED

Used Tools & Technologies

Not specified

Required Skills & Competences ?

Kafka @ 4 Kubernetes @ 4 Redis @ 4 Python @ 7 SQL @ 4 NoSQL @ 4 CI/CD @ 4 Distributed Systems @ 6 Hiring @ 4 Communication @ 4 JavaScript @ 7 MongoDB @ 4 Microservices @ 4

Details

You will collaborate closely with researchers to design and scale agents — enabling them to reason, plan, call tools and code just like human engineers. You will work on building and maintaining the core infrastructure for deploying and running these agents in production, powering our agentic tools and applications and ensuring their seamless and efficient performance. If you are passionate about the latest research and cutting-edge technologies shaping generative AI, this role and team offer an exciting opportunity to be at the forefront of innovation.

Responsibilities

  • Design, develop, and improve scalable infrastructure to support the next generation of AI applications, including copilots and agentic tools.
  • Drive improvements in architecture, performance, and reliability, enabling teams to bring to bear LLMs and advanced agent frameworks at scale.
  • Collaborate across hardware, software, and research teams; mentor and support peers while encouraging best engineering practices and a culture of technical excellence.
  • Stay informed of the latest advancements in AI infrastructure and contribute to continuous innovation across the organization.
  • Own end-to-end engineering solutions from architecture and development to deployment, integration, and ongoing operations/support.

Requirements

  • Master or PhD (or equivalent experience) in Computer Science or a related field, with a minimum of 5 years of experience in large-scale distributed systems or AI infrastructure.
  • Advanced expertise in Python (required) and strong experience with JavaScript.
  • Deep knowledge of software engineering principles, including OOP and functional programming, and experience writing high-performance, maintainable code.
  • Experience designing and running scalable microservices and web applications.
  • Experience with SQL and NoSQL databases, especially MongoDB and Redis, in production.
  • Experience with containers, Kubernetes, and CI/CD pipelines.
  • Solid experience with distributed messaging systems (e.g., Kafka) and integrating event-driven or decoupled architectures.
  • Practical experience integrating and fine-tuning LLMs or agent frameworks and tools (examples called out: LangChain, LangGraph, AutoGen, OpenAI Functions, RAG, vector databases).
  • Demonstrated ownership of engineering solutions across architecture, development, deployment, integration, and support.
  • Excellent communication skills and a collaborative, proactive approach.

Compensation & Other Details

  • Base salary ranges by level:
    • Level 4: 184,000 USD - 287,500 USD
    • Level 5: 224,000 USD - 356,500 USD
  • Eligible for equity and benefits.
  • Applications accepted at least until November 17, 2025.

Company & Equal Opportunity

NVIDIA is committed to fostering a diverse work environment and is an equal opportunity employer. NVIDIA does not discriminate (including in hiring and promotion) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status, or any other characteristic protected by law.