Principal Technical Program Manager

at Groq
📍 Mountain View, United States
USD 226,000-336,000 per year
SENIOR
✅ Remote

SCRAPED

Used Tools & Technologies

Not specified

Required Skills & Competences ?

Software Development @ 7 Leadership @ 4 Networking @ 4 Jira @ 4 Product Management @ 4 Agile @ 4

Details

Groq delivers fast, efficient AI inference. Our LPU-based system powers GroqCloud™, giving businesses and developers the speed and scale they need. Headquartered in Silicon Valley, we are on a mission to make high performance AI compute more accessible and affordable. When real-time AI is within reach, anything is possible. Build fast.

Responsibilities

  • Lead, plan and execute hardware systems and software programs at Groq.
  • Drive and manage end-to-end projects involving hardware design, system software, ML compiler, inference engine, infrastructure software, and the larger AI software stack.
  • Collaborate with hardware systems, systems software, product management, operations, and other cross-functional teams.
  • Provide deep technical guidance on AI chip architectures, FPGA, interconnects, memory hierarchies, low-level embedded software, ML compiler, inference engine, and infrastructure software to optimize performance and efficiency in datacenter deployments.
  • Drive internal and external communications including leadership reviews and core team meetings.
  • Define and track clear goals, priorities, and milestones aligned with Groq’s corporate goals.
  • Provide programmatic guidance, mentorship, and foster a culture of execution within system software, ML compiler, networking and other software teams.
  • Monitor project execution, identify risks, and implement mitigation strategies proactively.

Requirements

  • 7+ years of technical program management in hardware/software system design or AI/ML software development in AI domains.
  • Bachelor’s degree in engineering, computer science or related technical discipline, or equivalent experience.
  • Hands-on experience with system board design, system software development, or AI/ML software development.
  • Experience working with external vendors, managing deadlines, and accountability.
  • Understanding of AI software development and data center software stack.
  • Experience managing AI software product lifecycle from concept to delivery.
  • Understanding of hardware and software integration challenges.
  • Experience with project and program management tools and methodologies (e.g., Agile, Scrum, JIRA).
  • Expertise with scheduling tools like MS Project or Smartsheet.
  • Comfortable with ambiguity and actively seeking clarity.

Ways To Stand Out From The Crowd

  • Extensive experience in system design and end-to-end software development including AI chip development.
  • Deep knowledge of AI hardware system design, ML compiler design, inference engine design, and infrastructure software design.
  • Knowledge of LLVM and compiler architecture.
  • Experience with AI data center and cloud markets including technological and business trends.

Attributes of a Groqster

  • Humility, collaboration, growth mindset, curiosity, innovation, passion, grit, and boldness.

Compensation

Competitive base salary range from $226,000 to $336,000, part of a comprehensive compensation package including equity and benefits.

Location

Mountain View, California (Remote option available).