Senior Technical Program Manager, Infrastructure

at Glean
USD 198,000-235,500 per year
SENIOR
✅ Hybrid

Tech Stack

AI @ 4 AWS @ 7 Azure @ 7 Communication @ 7 Data Pipelines @ 4 Distributed Systems @ 4 GCP @ 7 LLM @ 4 Machine Learning Networking @ 7 Observability Performance Optimization SRE @ 8

Details

Glean is seeking a Senior Infrastructure Technical Program Manager (TPM) to lead large-scale, cross-functional initiatives that define, scale, and optimize its infrastructure platform. The role sits at the intersection of infrastructure engineering, reliability, cost efficiency, and AI systems, supporting a performant, scalable, and resilient platform.

The TPM will partner with Infrastructure, AI/ML, Platform Engineering, SRE, Data, Finance, and engineering leadership teams to design orchestration systems, streamline deployments, and build the foundations that power Glean's search and AI capabilities.

Responsibilities

  • Drive the Infrastructure roadmap across Setup & Deployment, Runtime, Storage, and AI Infrastructure.
  • Lead cross-functional programs that improve scalability, reliability, cost efficiency, and developer velocity.
  • Define and orchestrate how Glean instances are deployed, upgraded, and monitored at scale.
  • Partner with AI and Data teams to evolve ML pipelines, model training infrastructure, and the LLM serving stack.
  • Lead initiatives to improve observability, configuration management, and resource utilization.
  • Coordinate capacity planning, infrastructure migrations, and performance optimization programs.
  • Build visibility into infrastructure cost drivers and partner with Finance and engineering leaders on optimization initiatives.
  • Lead end-to-end infrastructure programs spanning compute, networking, storage, orchestration, and AI workloads.
  • Partner with Engineering to define standards for environment provisioning, deployment automation, and configuration governance.
  • Develop and operationalize frameworks for runtime health, scaling, and disaster recovery.
  • Drive consistency and automation across deployment orchestration systems.
  • Establish metrics for reliability, performance, and cost efficiency.
  • Coordinate delivery of high-impact programs such as data pipeline scalability, LLM infrastructure expansion, and infrastructure observability improvements.
  • Communicate program status and technical risks to leadership and stakeholders.
  • Identify process or system bottlenecks and drive automation to improve the speed and reliability of infrastructure operations.

Requirements

  • Bachelor's or master's degree in Computer Science, Engineering, or a related technical field.
  • 8–10+ years of experience in technical program management, infrastructure, or SRE, including at least 3–5 years managing infrastructure or platform-scale programs.
  • Proven success delivering cross-functional infrastructure programs in B2B or enterprise environments where scalability, uptime, and performance are critical.
  • Experience working with Infrastructure, SRE, and ML/AI teams on distributed systems or data infrastructure.
  • Strong understanding of cloud infrastructure, including compute, networking, storage, and orchestration systems, with experience in AWS, GCP, or Azure.
  • Understanding of data pipelines, ML training workflows, and LLM runtime infrastructure is a plus.
  • Ability to structure complex, multi-quarter infrastructure programs with clear milestones and measurable impact.
  • Strong written and verbal communication skills, with the ability to manage through ambiguity, anticipate scaling challenges, and align teams across priorities.
  • Builder mindset focused on automation, reliability, and efficiency.

Location and Work Policy

  • Hybrid role requiring four days per week in the Mountain View office.

Compensation and Benefits

  • Standard base salary range: $198,000–$235,500 annually.
  • Certain roles may be eligible for variable compensation, equity, and benefits.
  • Medical, vision, and dental coverage.
  • Generous time-off policy.
  • 401(k) plan.
  • Home office improvement stipend.
  • Annual education and wellness stipends.
  • Regular company events and healthy lunches daily.
  • Diverse and inclusive workplace.

Interview Process

As part of the interview process, candidates will complete a brief AI-focused exercise or discussion covering how they think about, design, and use AI to drive impact. Prior Glean experience is not required.

More jobs at Glean

Similar jobs