Network Engineer

Details

Groq is building a global cloud platform for production AI workloads, powered by its LPU inference technology. This role will own networking across GroqMetal’s management plane and tenant clusters, including network architecture, configuration, security, automation, and production operations.

The role covers host and cluster networking, data center fabrics, edge peering, interconnects, customer connectivity, tenant isolation, and network performance. The engineer will translate customer requirements into managed platform capabilities and ensure that networking can be provisioned, operated, diagnosed, and recovered reliably.

Responsibilities

• Translate customer connectivity, isolation, access, and performance requirements into supported platform features.
• Define how networking features are requested, provisioned, changed, observed, and removed throughout their lifecycle.
• Build Kubernetes-native automation to create, modify, and remove tenant networks and manage node membership through provisioning, scaling, repair, replacement, and reassignment.
• Verify isolation and connectivity during network and node lifecycle transitions, recover safely from partial failures, and remove stale configuration before resources are reassigned.
• Own dynamic configuration of tenant networks, BGP, routing policy, VLANs, and overlays across management, tenant, and external networks.
• Provision and manage networking capabilities through fabric-manager APIs, including customer service exposure, ingress and egress, VIPs, load balancers, and public IPs.
• Validate network convergence, failover, reachability, and isolation.
• Own networking for the Groq management plane and tenant clusters, including Cilium, network policy, service routing, ingress, egress, and integration with bare-metal networks.
• Automate tenant configuration and lifecycle operations for GPU networking, including NVL72 systems, InfiniBand, RoCE, and GPUDirect.
• Validate GPU network connectivity, isolation, and performance as tenant allocations and node membership change.
• Own dynamic address allocation, network inventory integration, and tenant network configuration through IPAM, NetBox, and fabric-manager APIs such as Netris and UFM.
• Keep intended configuration, applied state, and inventory consistent throughout tenant and node lifecycles.
• Own segmentation and traffic policy across the management plane, tenant clusters, and physical fabrics.
• Define permitted communication between environments and verify isolation during provisioning, scaling, maintenance, and hardware reassignment.
• Establish addressing, routing, and configuration standards for GroqMetal’s management plane and tenant networks.
• Implement declarative configuration and continuous reconciliation through Kubernetes-native controllers, fabric-manager APIs, and GitOps.
• Maintain code review, automated testing and validation, staged rollout, recovery procedures, and configuration-drift reconciliation.
• Own network telemetry, troubleshooting, and incident remediation across hosts, clusters, fabrics, and the edge.
• Diagnose packet loss, routing failures, congestion, and unexpected traffic, and turn recurring incidents into prioritized improvements.

Requirements

• Deep experience designing and operating networking services on data center infrastructure through deployment, expansion, maintenance, and incidents.
• Strong understanding of TCP/IP, BGP, routing policy, peering, ECMP, segmentation, and interconnects, including packet paths, failure diagnosis, and configuration-change consequences.
• Experience operating leaf-spine fabrics, underlay and overlay networks, and tenant separation using technologies such as VLANs, VRFs, and EVPN/VXLAN.
• Strong Kubernetes and Linux networking experience, including CNI behavior, Cilium or comparable systems, network policy, service exposure, and integration between cluster networking and physical infrastructure.
• Experience building Kubernetes controllers, operators, and custom resources in Go.
• Ability to integrate network APIs through reconciliation loops that safely handle retries, partial failures, and resource cleanup.
• Experience managing changes through version control, code review, automated testing, and controlled rollout.
• Experience building multitenant infrastructure or managed Kubernetes products, including customer onboarding, provisioning, upgrades, scaling, and production support.
• Experience securing networks that run customer workloads, including tenant separation, management network boundaries, traffic controls, and practical isolation testing.
• Experience with fabric management and IPAM systems such as Netris, UFM, NetBox, or comparable technologies.
• Experience with NVIDIA GPU infrastructure and AI networking, including InfiniBand, Spectrum-X, NVL72 systems, RDMA, RoCE, and congestion control.
• Experience networking large GPU clusters, including distributed workload performance, high-bandwidth east-west traffic, and multi-site connectivity.
• Ability to evaluate customer requirements and define network capabilities that the platform can reliably deliver and support.
• Candidates must be based in the Dallas, San Francisco, or New York City area.
• This position may require eligibility under U.S. export control laws and regulations.

Benefits

• Total Cash compensation includes potential bonus value directly in base pay.
• Long-Term Incentive (LTI) Program.
• Employee benefits suite.
• Equal employment opportunity and reasonable accommodation support.
• Remote work is available while the local Groq office is established, with an expectation of transitioning to onsite work once the office opens.