Staff Software Engineer

Details

Groq delivers fast, efficient AI inference. Our LPU-based system powers GroqCloud™, giving businesses and developers the speed and scale they need. Headquartered in Silicon Valley, we are on a mission to make high performance AI compute more accessible and affordable. When real-time AI is within reach, anything is possible. Build fast.

Responsibilities

• Design & Build APIs: Design, develop, and maintain scalable, high-performance backend systems and customer facing APIs that support our inference and console experiences.
• Infrastructure Deployment: Provision and deploy services into our Kubernetes-based environment.
• Testing and Validation: Develop and implement automated testing frameworks and test suites to ensure software quality and reliability. Write tests at all levels and scopes of Groq’s systems using best practices and pragmatic, scalable testing philosophy.
• Monitoring and Observability: Ensure that we understand the performance and quality of our services running in production and can swiftly respond when needed.
• Cross Functional Collaboration: Collaborate with product, design, and other engineers to ship features from idea to production.

Requirements

• 6+ years of software development experience
• 3+ years writing software in Go as your primary language
• Passion for LLMs and knowledge of how to interact with them (constrained decoding, output safeguards, etc)
• Strong understanding of API design principles and RESTful architectures
• Familiarity with multi-region application deployment and associated challenges
• Experience with Kubernetes, Terraform, PubSub/Kafka/Pulsar, and Stytch.
• Experience with Bigquery, Honeycomb, Prometheus + Grafana
• Experience building customer facing RESTful APIs
• Familiarity with streaming architectures and real-time data processing building large data processing flows
• Experience shipping code to production daily

Benefits

At Groq, a competitive base salary is part of our comprehensive compensation package, which includes equity and benefits. The base salary range for this role is $205,530 to $278,070, determined by your skills, qualifications, experience and internal benchmarks.

Logistical Requirements

You must be:

• Authorized to work in the United States
• Available to work US Pacific hours

Attributes of a Groqster:

• Humility - Egos are checked at the door
• Collaborative & Team Savvy - We make up the smartest person in the room, together
• Growth & Giver Mindset - Learn it all versus know it all, we share knowledge generously
• Curious & Innovative - Take a creative approach to projects, problems, and design
• Passion, Grit, & Boldness - no limit thinking, fueling informed risk taking

If this sounds like you, we’d love to hear from you!