Tech Stack
Tag name is followed by "@" symbol and proficiency level value.
About proficiency levels:
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
AI @ 6
Agentic Systems @ 4
Audit
Compliance @ 6
Data Engineering @ 6
Data Science @ 6
Databricks @ 4
FinTech @ 6
GenAI
Generative AI @ 6
LLM @ 4
Machine Learning
Python @ 6
SQL @ 6
Snowflake @ 4
Statistics @ 7
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Details
As a Senior Associate, Compliance Model Governance on the Compliance team, you will own quantitative testing, monitoring, and data quality for the AI and statistical models that power Coinbase's financial crime compliance programs, including transaction monitoring models. You will work across Compliance, Data Science, and Engineering to design tests, build pipelines and dashboards that track model health, and ensure that every production model is defensible to Internal Audit and regulators.
Responsibilities
- Design and execute quantitative testing for AI and ML models before and after launch, including input data quality testing, variance and stability testing, and performance testing for agentic and LLM-based systems.
- Produce documentation that withstands independent model validation and regulatory examination.
- Build and maintain monitoring pipelines and dashboards that track model inputs, outputs, and downstream outcomes, including SAR performance metrics.
- Apply statistical tests to detect model drift and degradation and deliver clear health readouts to model owners and Compliance leadership.
- Own data lineage for compliance-critical data elements.
- Design data quality checks that support Compliance's data quality control framework and partner with Engineering to trace data from source systems to control consumption.
- Write production-quality SQL and Python pipelines, diagnose and fix pipeline bugs, and lead data migrations supporting external regulatory reporting.
- Build detective monitoring scenarios to test whether compliance controls are working, including writing and validating the underlying SQL logic.
- Prepare testing evidence, model documentation, and walkthroughs for Internal Audit, model validators, and regulators.
- Respond to findings and track remediation through closure.
Requirements
- 4+ years of experience in data science, model risk, quantitative analytics, or data engineering, ideally in financial services, fintech, or another regulated setting.
- Strong grounding in applied statistics, including hypothesis testing, drift and stability measures, sampling, and confidence intervals.
- Hands-on experience evaluating ML models, including LLM-based or agentic systems through methods such as accuracy testing against human-reviewed samples, variance analysis across runs, and input and payload monitoring.
- Advanced SQL and Python skills.
- Experience building monitoring dashboards and working in cloud data environments such as Snowflake or Databricks.
- Experience with data lineage tracing and data quality rule design.
- Ability to write testing and model documentation that withstands independent review.
- Ability to communicate technical results clearly to non-technical compliance stakeholders and auditors.
- Responsible use of generative AI with human oversight to deliver business-ready outputs and improve workflow efficiency, cost, and quality.
Compensation
The annual base salary range is $148,835–$175,100 USD, excluding equity and bonus. Total compensation may also include equity and bonus eligibility, as well as medical, dental, vision, and 401(k) benefits.
Work Arrangement
Coinbase is a remote-first, but not remote-only, company. Employees should expect quarterly in-person working sessions called “surges.” Candidates may submit a maximum of three applications within a six-month period.