Technical Program Manager, Data Center Infrastructure

at Groq
📍 United States
USD 223,600-331,900 per year
MIDDLE
✅ Remote ✅ Hybrid ✅ On-site

SCRAPED

Used Tools & Technologies

Not specified

Required Skills & Competences ?

Hiring @ 3 Leadership @ 5 Communication @ 3 Networking @ 3 Jira @ 5 BI @ 5 Power BI @ 5 Agile @ 1 GPU @ 3

Details

Groq delivers fast, efficient AI inference. Our LPU-based system powers GroqCloud™, giving businesses and developers the speed and scale they need. From our Bay Area roots to our growing global presence, we are on a mission to make high performance AI compute more accessible and affordable.

Role overview

You will serve as the central connector between the Compute‑Storage and Networking teams and coordinate cross‑functionally with Data Center Operations, Procurement, and external vendors. You will lead high‑impact data‑center infrastructure initiatives (rack‑level upgrades, power and cooling optimizations, GPU deployments) and ensure they are delivered on schedule, within scope, and to the highest quality standards.

Responsibilities

  • Act as primary liaison between Compute‑Storage and Networking groups to ensure cross‑team alignment.
  • Own end‑to‑end lifecycle of data‑center infrastructure programs (define scope, deliverables, timelines, success metrics).
  • Translate business goals into actionable plans and program artifacts.
  • Partner with Data Center Operations, Procurement, and external vendors to secure resources, negotiate contracts, and manage expectations.
  • Identify, track, and mitigate risks and blockers; develop contingency plans and escalate critical issues when necessary.
  • Champion program management best practices and implement/maintain program tracking tools (Jira, Confluence, Power BI, etc.).
  • Conduct post‑mortems, capture lessons learned, and drive process improvements to increase efficiency and reduce technical debt.

Requirements

  • Strong technical understanding of data‑center infrastructure: compute, storage, networking, power, cooling, and GPU technologies.
  • Proven track record managing complex, multi‑team programs with external dependencies.
  • Experience with program management tools and frameworks; familiarity with Agile/Lean frameworks is a plus.
  • Excellent stakeholder management, communication, and vendor negotiation skills.
  • Analytical, data‑driven decision making and risk assessment capabilities.
  • Leadership and influence: able to lead without direct authority and align cross‑functional teams.

Tools & technologies mentioned

  • Jira
  • Confluence
  • Power BI
  • Compute, Storage, Networking technologies
  • GPU technologies
  • Power & cooling infrastructure

Why Join Us / Benefits

  • Purposeful, intentional hiring and a high‑performing team.
  • Hands‑on role where your work shapes company trajectory.
  • Mission‑driven work, tackling complex technical challenges.
  • Competitive compensation, equity, and benefits.

Location

  • Ideally Bay Area, CA. (Groq lists remote, hybrid, and onsite options via #LI-Remote, #LI-Hybrid, #LI-Onsite.)

Compensation

  • USA base salary range: $223,600 to $331,900 (base; final offer depends on location, skills, qualifications, experience and internal benchmarks). Compensation for candidates outside the USA will depend on the local market.

If this sounds like you, Groq encourages you to apply. Groq is an Equal Opportunity Employer and will provide reasonable accommodations for applicants with disabilities.