Software Engineer, AI Infrastructure

at Glean

USD 175,000-270,000 per year

MIDDLE

✅ Hybrid

Tech Stack
Tag name is followed by "@" symbol and proficiency level value. About proficiency levels:

1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;

3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;

7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;

10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.

AI @ 3 API @ 3 Agentic Systems Experimentation @ 3 GenAI Generative AI @ 3 Go @ 6 Java @ 6 LLM @ 3 Machine Learning Mathematics @ 3 Python @ 6 RAG @ 3

Details

Glean is building a Work AI platform that combines enterprise search, an AI Assistant, and scalable AI agents. The platform includes over 100 enterprise SaaS connectors, flexible LLM choice, robust APIs, and enterprise and personal knowledge graphs.

The engineering team works across generative AI, retrieval-augmented generation (RAG), query understanding, document understanding, domain-adapted language models, natural-language question answering, evaluation, and experimentation.

Responsibilities

Design, build, and improve AI/ML systems and data pipeline infrastructure.
Develop platforms that power large language model serving, routing, and orchestration at scale.
Work with and enable engineers focused on modeling and agentic capabilities.
Build agentic systems that use AI to proactively monitor, diagnose, debug, and maintain infrastructure health across cloud deployments.
Write robust, readable, maintainable, and testable code.
Mentor more junior engineers and learn from experienced engineers.
Interact regularly with customers, understand their pain points, and use appropriate tools to solve their problems.

Requirements

2–5 years of experience.
BA/BS degree in computer science, mathematics, sciences, or a related field.
Proven ability to design, build, and ship production-ready software, ideally involving AI/ML infrastructure such as batch processing pipelines, serving infrastructure, or LLM orchestration.
Strong coding skills in Python, Go, or Java.
Ability to thrive in a customer-focused, tight-knit, and cross-functional environment.
Team-oriented mindset and willingness to take on impactful work across the company.
Proactive and positive attitude, with the ability to lead, learn, troubleshoot, and take ownership of tasks and features.

Location

Hybrid role requiring 3–4 days per week in the Mountain View office.

Compensation And Benefits

Standard base salary range: $175,000–$270,000 annually.
Certain roles may be eligible for variable compensation, equity, and benefits.
Medical, vision, and dental coverage.
Generous time-off policy.
401(k) plan.
Home office improvement stipend.
Annual education and wellness stipends.
Regular company events and healthy daily lunches.

Interview Process

Candidates complete a brief AI-focused exercise or discussion covering how they think about, design, and use AI to drive impact. Prior Glean experience is not required.

Glean is committed to an inclusive and diverse workplace and does not discriminate based on gender, ethnicity, sexual orientation, religion, civil or family status, age, disability, or race.