Senior Staff Software Engineer

Details

GroqMetal is building an infrastructure platform that turns large-scale physical compute into reliable, isolated, customer-consumable AI infrastructure. This hands-on Senior Staff role involves writing production software as part of a software engineering team and leading the design of a Kubernetes-based software platform for large-scale AI training and inference workloads.

Responsibilities

• Design and build core Groq platform systems, including APIs, controllers, operators, reconciliation loops, and infrastructure abstractions.
• Write, review, test, debug, and operate substantial production code while providing Senior Staff technical leadership.
• Use Kubernetes to build a commercial AI infrastructure product, delivering production-grade Kubernetes services for dedicated customers running large-scale AI training and inference workloads.
• Apply distributed-systems principles involving partial failure, retries, concurrency, consistency, idempotency, availability, and recovery.
• Design stable platform APIs and contracts that decouple the customer experience from changes in backend infrastructure.
• Collaborate across infrastructure, inference, networking, information security, and other teams to turn ambiguous platform needs into production systems.

Requirements

• Strong experience designing, implementing, testing, shipping, and maintaining production software.
• Deep Kubernetes platform engineering experience, including operators and controllers, custom resource definitions (CRDs), admission control, node lifecycle, cluster services, and production-grade platform design.
• Strong practical distributed-systems expertise, including CAP, consensus, leader election, eventual consistency, state reconciliation, fault domains, and recovery.
• Experience developing infrastructure software through a robust software development lifecycle, including design reviews, automated testing, CI/CD, staged rollouts, rollback, observability, and incident learning.
• Practical knowledge of delivering Kubernetes, cloud infrastructure, or infrastructure control planes as commercially critical or externally consumed products is highly valued but not required.
• Hands-on experience using coding agents such as Codex, Claude Code, or similar systems or harnesses in substantive engineering work is highly valued.
• Experience at a hyperscaler or neocloud supporting AI workloads or commercializing GPU clusters, with a strong understanding of the operational and product challenges of large-scale accelerator infrastructure.
• Experience with inference platforms, accelerator or GPU infrastructure, device plugins, cloud infrastructure, or customer-facing platform products.
• Candidates for the United States posting must meet applicable U.S. export-control eligibility requirements, including qualifying as a U.S. Person or being eligible for an applicable export license.

Benefits

Groq offers total cash compensation that incorporates potential bonus value into base pay, along with a Long-Term Incentive Program and a robust suite of employee benefits. Groq is an Equal Opportunity Employer and provides reasonable accommodations to qualified individuals with disabilities.

Work Arrangement

The role is based in the Dallas, San Francisco, or New York City area. Employees may work remotely while Groq establishes its local office, with the expectation that the role will transition to onsite once the office opens.