Senior Machine Learning Engineer, Developer Advocacy

Details

Grafana Labs is hiring a Senior Machine Learning Engineer to lead the evolution of its Interactive Learning recommendation system. The role focuses on building a personalized, continuously improving system driven by real-time product behavior, content metadata, customer context, and experimentation.

This is an applied product data science role. You will build, deploy, and operate recommendation models, design experiments, establish evaluation methodology, and define the scientific roadmap. You will partner with software engineers responsible for the production recommender codebase and with a Data Analyst supporting measurement, instrumentation, and analysis across Developer Advocacy.

Responsibilities

• Evolve the Interactive Learning Plugin's recommendation system.
• Develop personalized approaches to candidate selection, ranking, sequencing, and next-best-action recommendations.
• Own a real-time recommendation service.
• Develop, validate, version, monitor, and iterate on models used by the recommendation system.
• Own model training and serving.
• Define offline, online, and longitudinal measures of recommendation performance.
• Own feature pipelines, model monitoring, and architecture monitoring.
• Use existing data and infrastructure while identifying future instrumentation and platform requirements.
• Integrate incremental improvements into the existing recommender.
• Work with software engineers and data analysts to productionize models and integrate them safely into the recommender service.
• Partner with Product Analytics on metric definitions, instrumentation, data quality, dashboards, and experiment analysis.
• Collaborate with Developer Advocacy, Documentation, Product, Engineering, GTM, and other teams to translate ambiguous needs into testable hypotheses and measurable product decisions.
• Explain modeling choices, tradeoffs, uncertainty, and results to technical and non-technical audiences.

Requirements

• Experience building recommendation, ranking, search, matching, propensity, or next-best-action systems.
• Comfort starting with simple, explainable approaches when appropriate.
• Experience with HTTP/gRPC, streaming, and Go or TypeScript in distributed systems.
• Experience personally building, validating, monitoring, and iterating on models used in a product or operational environment.
• Ability to work effectively in version-controlled codebases and collaborate with engineers on production implementation.
• Strong product thinking and technical communication skills.
• Ability to identify important unknowns and create a sequence of models and experiments that improves a product.

Bonus Qualifications

• Experience with content, education, onboarding, or learning recommendation systems.
• Experience with SaaS product telemetry and customer-account data.
• Experience using warehouse-scale behavioral data.
• Experience with directed graphs, sequence models, or prerequisite-aware recommendations.
• Experience with contextual bandits or other exploration strategies.
• Familiarity with Grafana or the broader observability ecosystem.
• Experience with open source software or transparent development practices.
• Experience working with privacy, fairness, explainability, or responsible personalization constraints.

Compensation And Benefits

• UK base compensation range: GBP 91,755–GBP 110,106 per year.
• Restricted Stock Units (RSUs) included with all roles.
• 100% remote work.
• Career growth pathways.
• In-person onboarding.
• Global annual leave policy of 30 days per annum, including three Grafana Shutdown Days, subject to local legislation.

The position is fully remote and candidates are being considered in the United Kingdom.