Technical Product Manager - GenAI Platforms - AI Infrastructure - CTO Office

Details

Bloomberg’s CTO Office is the future-looking technical and product arm of Bloomberg L.P., working on the next generation of infrastructure, hardware, and applications that power the Bloomberg Terminal and beyond. The team’s work spans AI platforms, cloud infrastructure, open-source stewardship, and generative AI innovation.

Bloomberg’s AI platforms enable teams to build, deploy, evaluate, govern, and operate AI systems at scale. As Bloomberg expands its investment in generative and agentic AI, the company is scaling the model, cloud, compute, data, and infrastructure foundations behind intelligent products across Terminal, Enterprise, and client-facing experiences.

This role will define and execute foundational capabilities for AI infrastructure, including cloud, compute, data, networking, and runtime foundations. The Technical Product Manager will help shape how teams experiment with, access, deploy, serve, and operate AI models across varied infrastructure environments.

Responsibilities

• Define and drive the vision for Bloomberg’s AI infrastructure across models, compute, and cloud.
• Work with AI product and engineering teams to understand requirements for model quality, performance, scale, reliability, and cost, and translate common needs into reusable platform capabilities.
• Partner with engineering to deliver scalable and resilient system architecture.
• Advance hybrid and multi-cloud capabilities, including portability, resilience, scalability, and integration with model and cloud providers.
• Evaluate cloud platforms, model providers, infrastructure services, model-serving technologies, accelerators, and emerging AI infrastructure capabilities.
• Establish product metrics and strategies for improving latency, throughput, availability, utilization, capacity, and cost efficiency across AI workloads.
• Align priorities, dependencies, and investments across AI Platforms, Cloud, Security, Engineering, and other infrastructure organizations.
• Anticipate the evolution of AI workloads and infrastructure requirements while balancing standardization, paved paths, flexibility, and choice.

Requirements

• 5+ years of experience in technical product management, ideally in AI, platform, cloud, compute, or infrastructure domains.
• Experience building, operating, or product-managing large-scale platform infrastructure used by internal or external developers.
• Experience with public cloud platforms such as AWS, GCP, or Azure, and familiarity with hybrid or multi-cloud architecture.
• Strong understanding of distributed systems, service-to-service communication, API gateways, Kubernetes, cloud-native architectures, and service reliability.
• Technical fluency in AI workload tradeoffs involving latency, throughput, availability, scalability, accelerator utilization, and cost.
• Familiarity with AI or GenAI systems, LLMs, generative AI, and production requirements.
• Proven ability to work cross-functionally with engineering, security, product, and platform organizations.
• Excellent communication and storytelling skills, with the ability to translate between user needs, business priorities, and technical architecture and influence diverse teams.

Preferred Qualifications

• Degree in Computer Science, Engineering, a related technical discipline, or equivalent practical experience.
• Experience with GPU or accelerator infrastructure, HPC workloads, capacity planning, scheduling, or multi-tenant resource management.
• Experience with AI infrastructure platforms, MLOps, inference or training platforms, model gateways, inference techniques, model-as-a-service offerings, or model optimization.
• Contributions to open-source infrastructure, AI, or developer ecosystems.
• Familiarity with financial services or other large-scale, regulated enterprise environments.

Benefits

Benefits may include merit increases, incentive compensation for exempt roles, paid holidays, paid time off, medical, dental, vision, short- and long-term disability benefits, 401(k) matching, life insurance, and wellness programs. The role also includes benefits and bonus eligibility as applicable.

Compensation

Salary range: $140,000–$295,000 USD annually, plus benefits and bonus. Actual compensation may vary based on geographic location, work experience, market conditions, education or training, and skill level.