Senior Machine Learning Engineer, Developer Advocacy

Details

Grafana Labs is hiring a Senior Machine Learning Engineer to lead the evolution of its Interactive Learning recommendation system. The system helps users discover guides, actions, and product experiences through personalized recommendations based on real-time product behavior, content metadata, customer context, and experimentation.

This is a fully remote position for candidates in Ireland. It is an applied product data science role involving recommendation model development, deployment, operation, experimentation, evaluation methodology, and scientific roadmap definition. The role partners closely with software engineers responsible for the production recommender codebase and with a Data Analyst supporting measurement, instrumentation, and analysis across Developer Advocacy.

Responsibilities

• Evolve the Interactive Learning Plugin's recommendation system.
• Develop personalized approaches to candidate selection, ranking, sequencing, and next-best-action recommendations.
• Own a real-time recommendation service.
• Develop, validate, version, monitor, and iterate on models used by the recommendation system.
• Own model training and serving.
• Develop offline, online, and longitudinal measures of recommendation performance.
• Own feature pipelines and monitoring of the model and architecture.
• Use available data and infrastructure to ship incremental improvements while identifying future instrumentation and platform requirements.
• Integrate improvements into the existing recommender rather than waiting for a complete replacement system.
• Work with software engineers and data analysts to productionize models and integrate them safely into the recommender service.
• Partner with Product Analytics on metric definitions, instrumentation, data quality, dashboards, and experiment analysis.
• Collaborate with Developer Advocacy, Docs, Product, Engineering, GTM, and other teams to turn ambiguous needs into testable hypotheses and measurable product decisions.
• Explain modeling choices, tradeoffs, uncertainty, and results to technical and non-technical audiences.

Requirements

• Experience building recommendation, ranking, search, matching, propensity, or next-best-action systems.
• Ability to use simple, explainable approaches when they are the best way to learn.
• Experience with HTTP/gRPC, streaming, and Go or TypeScript in distributed systems.
• Experience personally building, validating, monitoring, and iterating on models used in a product or operational environment.
• Ability to work effectively in version-controlled codebases and collaborate with engineers on production implementation.
• Strong product thinking and technical communication skills.
• Ability to take an ambitious and ambiguous objective, identify important unknowns, and create a sequence of models and experiments that improves the product.

Bonus Qualifications

• Experience with content, education, onboarding, or learning recommendation systems.
• Experience with SaaS product telemetry and customer-account data.
• Experience using warehouse-scale behavioral data.
• Experience with directed graphs, sequence models, or prerequisite-aware recommendations.
• Experience with contextual bandits or other exploration strategies.
• Familiarity with Grafana or the broader observability ecosystem.
• Experience with open source software or transparent development practices.
• Experience working with privacy, fairness, explainability, or responsible personalization constraints.

Benefits

• Base compensation in Ireland of EUR 104,000–EUR 124,800.
• Restricted Stock Units for all team members.
• 100% remote work and a global culture.
• In-person onboarding.
• Global annual leave policy of 30 days per annum, including 3 Grafana Shutdown Days.
• Career growth pathways, transparent communication, empowered teams, and an open-source culture.
• Equal opportunity employment.