Senior Staff Product Manager

Details

Mission

Groq is building a global cloud platform for high-performance AI inference, powered by its LPU—the first processor designed specifically for AI inference. This role will shape the future of AI inference by building platform capabilities that enable developers and enterprises to bring AI applications to life at scale.

As a Senior Staff Product Manager, you will own product strategy and execution for critical areas of Groq's AI Inference Platform. You will work at the intersection of AI infrastructure, cloud technology, and distributed systems, partnering closely with Engineering and cross-functional teams to define and deliver scalable, reliable, and intuitive product experiences.

Responsibilities

• Drive hands-on product definition and delivery, translating customer needs, technical constraints, and business priorities into detailed specifications, feature requirements, success metrics, and execution plans from concept through launch and continuous improvement.
• Bring deep AI infrastructure and cloud platform expertise to complex platform initiatives, contributing to technical specifications, architecture discussions, and roadmap priorities across multiple product workstreams.
• Partner with Platform Engineering, Distributed Systems, Cloud Infrastructure, Reliability Engineering, Hardware Engineering, and customer-facing teams to deliver scalable, reliable, and customer-centric platform capabilities.
• Partner with engineering leadership to navigate technical trade-offs and balance customer impact, technical investments, platform scalability, and long-term architectural evolution.
• Shape customer-facing cloud capabilities, including inference APIs, developer workflows, and platform experiences that make complex infrastructure easy to adopt, deploy, and scale.
• Define and prioritize internal platform investments across cloud infrastructure, resource management, observability, and platform optimization to improve scalability, reliability, operational efficiency, and infrastructure utilization.
• Lead customer discovery with enterprise AI customers and developers to understand inference workloads, deployment workflows, performance expectations, operational challenges, and emerging infrastructure needs.
• Measure product adoption, customer experience, and platform performance using customer feedback, telemetry, and operational metrics to continuously improve customer outcomes.
• Collaborate with Sales, Solutions Engineering, Customer Success, and Marketing to support product launches, customer adoption, and go-to-market initiatives.
• Monitor the evolving AI inference and cloud infrastructure landscape to identify emerging technologies, customer needs, and opportunities for product differentiation.
• Communicate product strategy, roadmap, priorities, risks, and progress to executive leadership and cross-functional stakeholders.

Requirements

• 10+ years of Product Management experience, including at least 5 years leading highly technical platform, infrastructure, or cloud products.
• Deep domain expertise and demonstrated ownership of technically complex products in AI inference, cloud infrastructure, or related environments such as inference engines, LLM serving platforms, neoclouds, or AI cloud services.
• Strong understanding of distributed systems, cloud infrastructure, APIs, Kubernetes, observability, platform reliability, capacity planning, and multi-region architectures.
• Proven ability to independently define and deliver complex technical products, including developing specifications, prioritizing features, and driving execution with engineering teams.
• Strong technical judgment and a track record of partnering with senior engineering leaders to translate customer needs into product strategy, influence architectural decisions, and deliver scalable infrastructure capabilities.
• Highly self-directed and comfortable navigating ambiguity, making decisions, and driving progress with minimal oversight.
• Strong analytical and problem-solving skills with a data-driven approach to prioritization and decision-making.
• Excellent written and verbal communication skills, with the ability to influence engineering teams, cross-functional stakeholders, and executive leadership.
• Bachelor's degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience.

Preferred Experience

• Familiarity with infrastructure utilization, fleet scheduling, capacity forecasting, cloud economics, and platform operations.
• Experience with consumption-based cloud services for enterprise customers, AI accelerators, or hardware and system bring-up.

Compensation

The total cash salary range for this position, inclusive of potential bonus value, is $310,400–$365,200 per year. Individual placement depends on geographic location, experience, skills, and alignment with internal compensation standards. The stated range applies to candidates located in the United States. International compensation varies based on local market dynamics. Groq also offers a Long-Term Incentive Program and employee benefits.

Work Authorization

This position may require access to technology or information subject to U.S. export control laws and regulations, including the Export Administration Regulations. Candidates must meet applicable citizenship, residency, or export license eligibility criteria. Employment offers are contingent upon verification of identity and employment authorization.

Groq is an Equal Opportunity Employer committed to an inclusive workplace and provides reasonable accommodations to qualified individuals with disabilities.