Staff AI Engineer

📍 Canada

CAD 186,400-230,000 per year

SENIOR

✅ Remote

Tech Stack
Tag name is followed by "@" symbol and proficiency level value. About proficiency levels:

1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;

3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;

7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;

10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.

AI @ 7 AWS @ 6 Azure @ 6 Codex DevOps @ 4 Docker @ 4 Experimentation GCP @ 6 GenAI @ 4 Grafana @ 4 Kubernetes @ 4 LLM Observability @ 4 Prompt Engineering @ 4 Security Terraform @ 4

Details

Grafana Labs builds observability tools that help users understand, respond to, and improve their systems. The Grafana AI teams help users make sense of complex observability data through AI-driven features that reduce toil, lower the barrier of domain expertise, and surface meaningful signals from noisy environments.

This is a remote opportunity. Grafana is interested in applicants from Canada time zones only.

Responsibilities

Build and deliver AI solutions: Develop high-performance AI features to help users detect, triage, and resolve incidents using observability data and tools.
Rapid experimentation and iteration: Prototype, test, and validate with real users; ship and evolve LLM- or agent-powered workflows for incident lifecycle management and automated analysis tasks.
Collaborate cross-functionally: Work with data analysts, product managers, and designers to shape AI-driven product features, including integration of agentic components with internal tools, alerting systems, runbooks, and developer workflows.
Utilize AI tools effectively: Use AI and automation tools to enhance product functionality and development workflows.
Effective communication: Contribute across teams in a highly dynamic, collaborative environment.
Ownership and impact: Ensure AI solutions are scalable, maintainable, and aligned with real user workflows.

Grafana also invests in developer productivity and allows modern AI coding assistants as part of daily workflow (within security guidelines), supported by a company-funded usage budget. The role supports pragmatic AI-assisted development (prototyping, test generation, refactors, documentation, and incident follow-ups) with strong code review and quality standards. Engineers may have access to frontier models (e.g., GPT-Codex 5/3, Claude Opus 4.6, Gemini 3 Pro).

Requirements

Experience with LLMs, prompt engineering, and building applications powered by GenAI.
Proven track record of delivering software that made it into production and is actively used by users.
Exposure to working in cloud-native environments (AWS, GCP, Azure).
Experience using observability tools to understand and troubleshoot system behavior.

Bonus Points For

Experience building or working with agent frameworks or multi-agent workflows.
Experience with infrastructure / devops related tooling: Kubernetes, Docker, Terraform or similar for deployments.
Familiarity with model fine-tuning techniques.
Experience building observability tooling.

Benefits

100% Remote, Global Culture.
RSUs: All roles include Restricted Stock Units (RSUs), giving every team member ownership in Grafana Labs' success.
In-person onboarding.
Balance is Key: Global annual leave policy of 30 days per annum, with 3 days reserved for Grafana Shutdown Days. Grafana will comply with local legislation where applicable.