Senior Staff Software Engineer

Details

GroqMetal is building an infrastructure platform that turns large-scale physical compute into reliable, isolated, customer-consumable AI infrastructure. This hands-on Senior Staff role involves writing production software and leading the design of a Kubernetes-based software platform for large-scale AI training and inference workloads.

Responsibilities

• Design and build core Groq platform systems, including APIs, controllers, operators, reconciliation loops, and infrastructure abstractions.
• Write, review, test, debug, and operate substantial production code while providing Senior Staff technical leadership.
• Use Kubernetes to build a commercial AI infrastructure product and deliver production-grade Kubernetes services for dedicated customers running large-scale AI training and inference workloads.
• Apply distributed-systems principles involving partial failure, retries, concurrency, consistency, idempotency, availability, and recovery.
• Design stable platform APIs and contracts that decouple the customer experience from changes in backend infrastructure.
• Collaborate across infrastructure, inference, networking, information security, and other teams to turn ambiguous platform needs into production systems.

Requirements

• Strong experience designing, implementing, testing, shipping, and maintaining production software.
• Deep Kubernetes platform engineering experience, including operators and controllers, custom resource definitions (CRDs), admission control, node lifecycle, cluster services, and production-grade platform design.
• Strong practical distributed-systems expertise, including CAP, consensus, leader election, eventual consistency, state reconciliation, fault domains, and recovery.
• Experience developing infrastructure software through a robust software development lifecycle, including design review, automated testing, CI/CD, staged rollout, rollback, observability, and incident learning.
• Practical experience delivering Kubernetes, cloud infrastructure, or infrastructure control planes as a commercially critical or externally consumed product is highly valued but not required.
• Hands-on experience using coding agents such as Codex, Claude Code, or similar systems and harnesses in substantive engineering work is highly valued.
• Experience at a hyperscaler or neocloud supporting AI workloads or commercializing GPU clusters, with an understanding of the operational and product challenges of large-scale accelerator infrastructure.
• Experience with inference platforms, accelerator or GPU infrastructure, device plugins, cloud infrastructure, or customer-facing platform products.
• Candidates for U.S. roles may need to meet U.S. export-control citizenship, residency, or licensing requirements.

Work Location

The role is based in the Dallas, San Francisco, or New York City area. Employees may work remotely while the local Groq office is established, with the expectation that the role will transition to onsite work once the office opens.

Compensation

The total cash salary range for the Senior Staff level is $341,400–$401,600 per year, inclusive of potential bonus value. Individual placement depends on geographic location, experience, skills, and alignment with internal compensation standards. Groq also offers a Long-Term Incentive Program and employee benefits.

Benefits

• Long-Term Incentive Program.
• Employee benefits.
• Equal opportunity employment and reasonable accommodation support.