Staff Software Engineer, Streaming Systems

Details

About Groq

Groq delivers fast, efficient AI inference. Our LPU-based system powers GroqCloud™, giving businesses and developers the speed and scale they need. From our Bay Area roots to our growing global presence, we are on a mission to make high performance AI compute more accessible and affordable.

Mission

Design and build the real-time data infrastructure that powers GroqCloud’s global revenue engine, processing hundreds of billions of events each day, sustaining millions of writes per second, and enabling a multi-billion-dollar business to operate in real time. Drive the intelligence layer that fuels global billing, analytics, and real-time business operations at worldwide scale.

Responsibilities

• Architect high-performance data pipelines to ingest, process, and transform millions of structured and semi-structured events daily.
• Build distributed, fault-tolerant frameworks for streaming data from diverse sources.
• Create data services and APIs that make usage and billing data easily accessible across the platform.
• Develop lightweight tools and dashboards to monitor and visualize data ingestion, throughput, and system health.

Requirements / Ideal Candidate

• Strong background in real-time data processing, distributed systems, and analytics infrastructure.
• Hands-on experience with streaming technologies such as Kafka, Flink, Spark Streaming, or Redpanda.
• Experience with real-time analytics databases such as ClickHouse, Druid, or Pinot.
• Deep understanding of serialization, buffering, and data flow optimization in high-throughput systems.
• Experience designing data services/APIs and building observability for streaming systems.

Bonus (Nice to Have)

• Experience deploying and managing workloads on Kubernetes.
• A passion for systems performance, profiling, and low-latency optimization.
• Familiarity with gRPC and RESTful API design.

Attributes of a Groqster

• Humility – Egos are checked at the door
• Collaborative & Team Savvy – We make up the smartest person in the room, together
• Growth & Giver Mindset – Learn it all versus know it all, we share knowledge generously
• Curious & Innovative – Take a creative approach to projects, problems, and design
• Passion, Grit, & Boldness – No-limit thinking, fueling informed risk taking

Compensation

A competitive base salary is part of our comprehensive compensation package, which includes equity and benefits. For this role, the base salary range (for roles in the United States) is $245,800 to $289,200. Compensation for candidates outside the USA will be dependent on the local market.

Work Location & Policy

The posting includes remote, hybrid, and onsite options (#LI-Remote, #LI-Hybrid, #LI-Onsite). Specific location and work arrangement will be determined based on role and candidate location.

Equal Opportunity & Accommodations

Groq is an Equal Opportunity Employer and is committed to creating an inclusive environment for all employees and applicants. Reasonable accommodations for qualified individuals with disabilities are available; contact [email protected] for accommodation requests.