Senior Product Manager - Inference Platform

Details

Nebius is building a full-stack AI cloud platform for developers and enterprises, covering data and model training through production deployment. The Token Factory team is developing an AI inference platform for high-performance, cost-efficient workloads at scale, serving developers and managed enterprise customers.

As a Senior/Principal Product Manager, Inference Platform, you will join a team of product managers and own a core platform stream end to end, from strategy and roadmap through launch and adoption. The scope includes new models, modalities, hardware, customer needs, scalability, and reliability. The role can be performed remotely from the United States.

Responsibilities

• Own the roadmap and outcomes for part of the inference platform.
• Align multiple cross-functional engineering teams across public API, routing, performance, reliability, and enterprise enablement features.
• Work with engineering and research to make inference more scalable, reliable, and cost-efficient.
• Translate technical capabilities into products customers can depend on.
• Stay close to customers through research, interviews, and hands-on proofs of concept, especially in managed enterprise.
• Track open-source models, inference economics, and how businesses apply AI, turning market insights into product bets.

Requirements

• Experience shipping technical platform products, with the seniority to lead work across multiple engineering teams.
• Strong technical depth in AI inference, including model serving, distributed systems, and production infrastructure.
• Ability to independently analyze technical problems rather than relying on engineers to define them.
• Strong communication and expectations-management skills across engineering, research, sales, support, and leadership.
• Ability to write clear PRDs, RFCs, and release notes.
• B2B or enterprise experience working with technical buyers.
• Comfort with ambiguity and shifting scope.

Preferred Qualifications

• Post-training experience, including training draft models.
• Experience with third-party technical partnerships.

Benefits

• 100% company-paid medical, dental, and vision coverage for employees and families.
• 401(k) plan with up to a 4% company match and immediate vesting.
• Paid parental leave: 20 weeks for primary caregivers and 12 weeks for secondary caregivers.
• Remote work reimbursement of up to $85 per month for mobile and internet.
• Company-paid short-term disability, long-term disability, and life insurance.
• Career growth and learning opportunities.
• Flexibility and ownership.
• Collaborative and innovative culture.
• Opportunity to work on impactful AI projects.
• International environment and talented teams.

Applicants must be authorized to work in the country in which they apply and must provide proof of employment eligibility as a condition of hire. Nebius is an equal opportunity employer and provides accommodations during the application process upon request.