Used Tools & Technologies
Machine LearningRequired Skills & Competences
Tag name is followed by "@" symbol and proficiency level value.
About proficiency levels:
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Security @ 4
Go @ 6
Python @ 6
Rust @ 6
Microservices @ 6
API @ 6
LLM @ 4
Observability @ 4
Generative AI @ 4
Blockchain @ 4
AI @ 4
GenAI @ 4
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Details
Ready to do the most impactful work of your career? At Coinbase, we are uncompromising on our mission to increase economic freedom. The bar is high, the environment is intense, and we like it that way. This isn't a place for complacency — it's a place to be pushed past your perceived limits. Coinbase is a remote-first, but not remote-only company. Expect to get together quarterly for in-person working sessions called “surges.”
As a Staff Software Engineer on the AI Platform team within the Platform group, you'll build and operate the LLM and agent infrastructure that every team at Coinbase depends on. This team owns the company's single path to large language models and the full agent lifecycle: build, deploy, run, observe, and improve. You'll lead multi-quarter technical initiatives across the platform, from gateway and runtime systems to knowledge bases and applied AI agents, directly shaping how Coinbase scales AI across the organization.
Responsibilities
- Own the architecture and delivery of core platform systems including the LLM Gateway (60+ models, auth, PII redaction, fallbacks, cost optimization), AI Hub, and agent runtime with microVM sandboxes and governed MCP gateway
- Drive the design and implementation of Knowledge Base infrastructure, connecting data sources to auto-provisioned vector and markdown stores queryable by any agent
- Lead AI FinOps capabilities including spend attribution, governance, and cost optimization across all AI workloads company-wide
- Partner across engineering, security, legal, finance, product, and external partners at frontier labs and major cloud providers to ship high-impact platform capabilities
- Build evaluation and observability tooling including LLM-as-judge harnesses, full tracing, and feedback loops that let subject matter experts refine production agents
- Shape applied AI strategy by embedding with teams to build production agents, applying fine-tuning and traditional ML where it outperforms prompting
Requirements
- 8+ years of software engineering experience with at least 3 years building ML/AI infrastructure, LLM systems, or distributed platform services at scale
- Demonstrated ability to lead multi-quarter, Staff-level initiatives end-to-end, from technical design through production operation, with measurable platform-wide impact
- Deep expertise in LLM orchestration patterns, agent frameworks, vector databases, and model serving infrastructure across multiple providers
- Proven track record of cross-functional partnership with security, legal, and product teams to ship governed, production-grade AI systems
- Fluency in Python and at least one systems language (Go, Rust, or C++), with production experience building APIs, microservices, and runtime environments
- Utilizes generative AI responsibly, maintaining human oversight to deliver business-ready outputs and drive measurable improvements in workflow efficiency, cost, and quality
Public Blog Posts
- https://www.coinbase.com/blog/NodeSmith-AI-Driven-Automation-for-Blockchain-Node-Upgrades
- https://www.coinbase.com/blog/making-smarter-decisions-faster-with-AI-at-Coinbase
- https://www.coinbase.com/en-gb/blog/cb-gpt-the-opportunity-and-the-vision-for-genAI-at-coinbase
- https://www.coinbase.com/en-gb/blog/lessons-from-launching-enterprise-grade-genAI-solutions-at-Coinbase
- https://www.youtube.com/watch?v=IkK6dSsC5fU
Compensation
Base salary varies by location. Annual base salary range (excluding equity and bonus): $218,025 — $256,500 USD. Total compensation may also include equity and bonus eligibility.
Benefits
- Medical, dental, vision
- 401(k)
- Equity and bonus eligibility
Additional information
- Job ID#: P76979
- Application limit: Candidates may submit a maximum of 3 applications within a 6-month period.
- Equal Opportunity Employer statements, US applicant rights information, E-Verify participation, and accommodation instructions are provided in the posting.
- AI Disclosure: Coinbase is piloting AI tools for initial screening interviews and interview intelligence; Coinbase will not use AI to make employment decisions.