Senior Full Stack Engineer | Experimentation - Product Analytics | NASA | Remote
Tech Stack
Tag name is followed by "@" symbol and proficiency level value.
About proficiency levels:
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
A/B Testing @ 4
AI @ 6
Automated Testing @ 6
Experimentation @ 4
Go @ 4
Grafana @ 4
Kubernetes @ 4
Observability
Prometheus @ 4
React @ 7
SQL @ 4
Statistics
TypeScript @ 7
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Details
Grafana Labs is building a native experimentation platform: a Grafana app that lets teams define A/B tests, connect them to feature flags and product telemetry, and obtain statistically sound results. The experimentation app is currently used internally by Grafana engineering and product teams and is being developed into a first-class product for Grafana Cloud customers.
This is a full-time remote opportunity for candidates in the United States and Canada in the EST time zone. You will join the Product Analytics team as its dedicated software engineer, owning the engineering of the experimentation app and partnering with data scientists, data engineers, software engineers, and product stakeholders. This is a hands-on software engineering role, not an analyst role.
Responsibilities
- Evolve the experimentation app from an internal tool into a production product, owning features end to end across the React frontend and Go backend.
- Build workflows for defining hypotheses, configuring experiments and metrics, managing experiment lifecycles, and exploring results.
- Improve the experimentation SDK and its OpenFeature and Grafana Faro integrations.
- Help teams connect variant assignment, exposure, and outcome events through consistent identity and event contracts.
- Integrate experiments with Grafana Faro, Frontend Observability, Session Replay, and critical user journeys.
- Extend the statistics engine and make analysis scalable, cost-aware, and correct, including server-side computation, scheduled analysis, experiment-health alerting, and safeguards against misleading results.
- Extend Grafana Assistant integration for experiment authoring, explanation, and reporting.
- Mentor teammates through code reviews, pairing, and design documents.
- Write architecture decision records, documentation, and demos to support adoption.
- Participate in on-call for the services you build and support internal teams using them.
Product and Technology Stack
- Frontend: TypeScript, React,
@grafana/ui, and a custom datasource plugin. - Backend: Go and the Grafana App SDK.
- Platform: Kubernetes-style custom resources defined in CUE, an operator, admission webhooks, and declarative GitOps-style management.
- Feature flags: OpenFeature, the OpenFeature Remote Evaluation Protocol (OFREP), Grafana's multi-tenant feature toggle service, and an embedded GO Feature Flag evaluator.
- Statistics: A Bayesian analysis engine written in TypeScript with a Go port, producing direction-aware verdicts, probability to be best, credible intervals, expected loss, and sample-size recommendations.
- Data: RudderStack, BigQuery, Grafana Faro, Loki, and Grafana datasources.
- AI: Grafana Assistant for discovering relevant data and drafting experiment configurations.
Requirements
- Strong full-stack engineering experience building and operating production web applications with TypeScript and React.
- Backend development experience in Go or a similar language, with willingness to work in Go.
- Experience building or integrating an experimentation or A/B testing platform, such as Statsig, Eppo, GrowthBook, Optimizely, LaunchDarkly experiments, or an internal platform.
- Product and data intuition, including experience with event data, SQL, and data warehouses such as BigQuery.
- Ability to deliver complex projects with minimal supervision and work through short feedback loops.
- Production operations experience, including on-call responsibilities and building observable and debuggable software.
- Thoughtful use of AI coding tools with validation of generated output.
- Ability to explain technical and statistical tradeoffs to engineers, analysts, and product managers in a remote, asynchronous environment.
- Maintainability, automated testing, and secure development practices.
Bonus Qualifications
- Experience with feature flags and OpenFeature.
- Understanding of Bayesian or frequentist testing, sample sizing, variance reduction, peeking, and sample-ratio mismatch.
- Experience with Kubernetes custom resources, operators, admission webhooks, or GitOps.
- Experience building Grafana plugins or apps, or using the Grafana App SDK or Scenes.
- Familiarity with Grafana Faro, real-user monitoring, session replay, RudderStack, or Segment.
- Open-source contribution or maintainership experience.
- Experience using Grafana, Prometheus, Loki, or Tempo.
Benefits
- Base compensation in the United States of USD $167,000–$209,000 per year.
- Restricted Stock Units (RSUs).
- Remote-first culture with global collaboration.
- Company-funded usage budget for AI coding assistants.
- Career growth opportunities and in-person onboarding.
- Global annual leave policy of 30 days per year, including three Grafana Shutdown Days.
- Transparent communication, empowered teams, and open-source-oriented values.