Software Engineer, Model Evaluation Systems Intern

Details

Groq delivers fast, efficient AI inference. Our LPU-based system powers GroqCloud™, giving businesses and developers the speed and scale they need. Headquartered in Silicon Valley, we are on a mission to make high performance AI compute more accessible and affordable. When real-time AI is within reach, anything is possible. Build fast.

Responsibilities

• Software Development: Write simple, concise, high-performance code in Python and Golang to support evaluation pipelines and tooling.
• Model Evaluation & Benchmarking: Develop and implement benchmarking tools to assess the performance of models hosted on Groq, ensuring Groq’s AI infrastructure remains at the cutting edge of efficiency and performance.
• Automation & Tooling: Build automated evaluation systems and testing infrastructure to streamline model deployment and validation processes.
• System Integration & Testing: Work closely with cross-functional teams to integrate models into Groq’s infrastructure, ensuring seamless operation and accurate evaluation across various system configurations.
• Data-Driven Insights: Collect and analyze performance data, providing actionable insights and recommendations for improving model performance, scalability, and reliability.

Requirements

• Current student pursuing a degree in computer science, engineering, or a related field or recent graduate (within 6 months)
• A demonstrated interest in building or working with evaluation systems or working on novel applied AI projects.
• Proficiency in Python and Golang, with strong software engineering fundamentals and best practices.
• Self-Driven: Ability to see projects through end-to-end independently, taking initiative to optimize systems proactively.
• Deep problem-solving skills — candidates should be able to tackle non-trivial challenges with minimal guidance.
• Ability to work across unconventional AI problems, iterate quickly, and ship impactful solutions.
• Contributions to open-source projects or prior startup experience is a big plus.
• Must be authorized to work in the United States or Canada.

Benefits

The US pay range for our technical internships is $30-$50 / per hour. Individual compensation will be commensurate with the candidate’s qualifications and experience, country of internship and aligned with Groq’s internal leveling guidelines and benchmarks.