Senior Machine Learning Engineer, Developer Advocacy | US | Remote

Details

Grafana Labs is hiring a Senior Machine Learning Engineer to lead the evolution of its Interactive Learning recommendation system. The role focuses on building a personalized, continuously improving system driven by real-time product behavior, content metadata, customer context, and experimentation.

This is an applied product data science role. You will build, deploy, and operate recommendation models, design experiments, establish evaluation methodologies, and define the scientific roadmap. You will work closely with software engineers responsible for the production recommender codebase and with a Data Analyst supporting measurement, instrumentation, and analysis across Developer Advocacy.

Responsibilities

• Evolve the Interactive Learning Plugin's recommendation system.
• Develop personalized approaches to candidate selection, ranking, sequencing, and next-best-action recommendations.
• Own a real-time recommendation service.
• Build, validate, version, monitor, and iterate on applied models.
• Own model training and serving.
• Develop offline, online, and longitudinal measures of recommendation performance.
• Own feature pipelines and monitoring of the model and architecture.
• Use existing data and infrastructure while identifying future instrumentation and platform requirements.
• Integrate incremental improvements into the existing recommender system.
• Partner with software engineers and data analysts to productionize models and integrate them safely into the recommender service.
• Collaborate with Product Analytics on metric definitions, instrumentation, data quality, dashboards, and experiment analysis.
• Work with Developer Advocacy, Documentation, Product, Engineering, Go-To-Market, and other teams to translate ambiguous needs into testable hypotheses and measurable product decisions.
• Explain modeling choices, tradeoffs, uncertainty, and results to technical and non-technical audiences.

Requirements

• Experience building recommendation, ranking, search, matching, propensity, or next-best-action systems.
• Ability to use simple, explainable approaches when appropriate.
• Experience with HTTP/gRPC, streaming, and Go or TypeScript in distributed systems.
• Experience personally building, validating, monitoring, and iterating on models used in a product or operational environment.
• Ability to work effectively in version-controlled codebases and collaborate with engineers on production implementation.
• Strong product thinking and technical communication skills.
• Ability to identify important unknowns and create a sequence of models and experiments that improves a product.

Bonus Qualifications

• Experience with content, education, onboarding, or learning recommendation systems.
• Experience with SaaS product telemetry and customer-account data.
• Experience using warehouse-scale behavioral data.
• Experience with directed graphs, sequence models, or prerequisite-aware recommendations.
• Experience with contextual bandits or other exploration strategies.
• Familiarity with Grafana or the broader observability ecosystem.
• Experience with open source software or transparent development practices.
• Experience working with privacy, fairness, explainability, or responsible personalization constraints.

Compensation & Benefits

• United States base compensation range: $154,445–$185,334 per year.
• Restricted Stock Units are included with all roles.
• 100% remote work in a global culture.
• In-person onboarding.
• Global annual leave policy of 30 days per year, including three Grafana Shutdown Days.
• Career growth pathways, transparent communication, and an innovation-driven environment.