Senior Full Stack Engineer | Experimentation - Product Analytics | Germany | Remote
Tech Stack
Tag name is followed by "@" symbol and proficiency level value.
About proficiency levels:
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
A/B Testing @ 4
AI @ 6
Automated Testing @ 4
Communication @ 6
Debugging @ 4
Experimentation @ 4
Go @ 4
Grafana @ 4
Kubernetes @ 4
Observability @ 4
Prometheus @ 4
React @ 7
SQL @ 6
Statistics
TypeScript @ 7
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Details
Grafana Labs is building a native experimentation platform: a Grafana app that enables teams to define A/B tests, connect them to feature flags and product telemetry, and obtain statistically sound results. The Product Analytics team works with data scientists, data engineers, software engineers, and product stakeholders. This is a hands-on software engineering role focused on shipping production code, not an analyst role.
Responsibilities
- Evolve the experimentation app from an internal tool into a customer-facing product.
- Own features end to end across the React frontend and Go backend, from problem framing and design through rollout, measurement, and iteration.
- Build workflows for defining hypotheses, configuring experiments and metrics, managing experiment lifecycles, and exploring results.
- Improve the experimentation SDK and its OpenFeature and Grafana Faro integrations.
- Connect variant assignment, exposure, and outcome events through consistent identity and event contracts.
- Integrate with Grafana Faro, Frontend Observability, Session Replay, and critical user journeys.
- Extend and scale the statistics engine, including server-side computation, scheduled analysis, experiment health alerting, and safeguards against misleading results.
- Extend Grafana Assistant for experiment authoring, explanation, and reporting.
- Mentor teammates through code review, pairing, and design documents.
- Write architecture decision records, documentation, and demos.
- Participate in on-call for services developed by the team and support internal teams using the platform.
Requirements
- Strong full-stack engineering experience building and operating production web applications with TypeScript and React.
- Backend development experience with Go or a similar language, with willingness to work in Go.
- Experience with maintainable code, automated testing, and secure development practices.
- Experience building an in-house experimentation or A/B testing platform, or integrating platforms such as Statsig, Eppo, GrowthBook, Optimizely, LaunchDarkly Experiments, or similar.
- Product and data intuition, including comfort with event data, SQL, and data warehouses such as BigQuery.
- Experience delivering complex projects with minimal supervision and using short feedback loops.
- Operational experience, including on-call responsibilities, production support, observability, and debugging.
- Thoughtful use of AI coding tools, with validation of generated output.
- Clear communication of technical and statistical trade-offs to engineers, analysts, and product managers in a remote, asynchronous environment.
- Intellectual curiosity, transparency, bias toward action, kindness, and a collaborative approach.
Bonus Qualifications
- Experience with feature flags and OpenFeature.
- Understanding of Bayesian or frequentist testing, sample sizing, variance reduction, peeking, and sample ratio mismatch.
- Experience with Kubernetes custom resources, operators, admission webhooks, or GitOps.
- Experience building Grafana plugins or apps, or using the Grafana App SDK or Scenes.
- Familiarity with Grafana Faro, real-user monitoring, session replay, RudderStack, Segment, or product analytics tooling.
- Open source contribution or maintainership.
- Experience using Grafana, Prometheus, Loki, or Tempo.
Technologies
The experimentation app uses TypeScript, React, Grafana UI, custom datasource plugins, Go, the Grafana App SDK, CUE, Kubernetes-style custom resources, operators, admission webhooks, GitOps, OpenFeature, OFREP, GO Feature Flag, BigQuery, Grafana Faro, Loki, RudderStack, Grafana Assistant, and Grafana datasources. Its statistics engine uses TypeScript and Go and supports Bayesian analysis, probability to be best, credible intervals, expected loss, and sample-size recommendations.
Compensation and Benefits
- Germany base compensation: €100,000–€125,000 per year.
- Restricted Stock Units are included in all roles.
- 100% remote work in a global culture.
- Company-funded usage budget for AI coding assistants.
- In-person onboarding.
- Global annual leave policy of 30 days per year, including three Grafana Shutdown Days.
- Career growth opportunities, transparent communication, and empowered teams.