Technical Product Manager - GenAI Platforms - AI Infrastructure - CTO Office

USD 140,000-295,000 per year
MIDDLE
✅ On-site

Tech Stack

AI @ 3 API @ 6 AWS @ 2 Azure @ 2 Communication @ 6 Distributed Systems @ 6 GCP @ 2 GPU @ 3 GenAI @ 2 Generative AI @ 2 HPC @ 3 Kubernetes @ 6 LLM MLOps @ 3 Networking Product Management @ 5 Security @ 3 System Architecture

Details

Bloomberg’s CTO Office is the future-looking technical and product arm of Bloomberg L.P., working across AI platforms, cloud infrastructure, open-source stewardship, and generative AI innovation.

The role focuses on defining and executing foundational AI infrastructure capabilities across cloud, compute, data, networking, and runtime environments. This includes enabling teams to experiment with, access, deploy, serve, evaluate, govern, and operate AI models across diverse infrastructure environments.

Responsibilities

  • Define and drive the vision for Bloomberg’s AI Infrastructure across models, compute, and cloud.
  • Work with AI product and engineering teams to understand requirements for model quality, performance, scale, reliability, and cost, and translate common needs into reusable platform capabilities.
  • Partner with engineering to deliver scalable and resilient system architecture.
  • Advance hybrid and multi-cloud capabilities, including portability, resilience, scalability, and integration with model and cloud providers.
  • Evaluate cloud platforms, model providers, infrastructure services, model-serving technologies, accelerators, and emerging AI infrastructure capabilities, translating them into platform opportunities and roadmap decisions.
  • Establish product metrics and strategies for improving latency, throughput, availability, utilization, capacity, and cost efficiency across AI workloads.
  • Align priorities, dependencies, and investments across AI Platforms, Cloud, Security, Engineering, Product, and other infrastructure organizations.
  • Anticipate the evolution of AI workloads and infrastructure requirements while balancing standardization, paved paths, flexibility, and choice.

Requirements

  • 5+ years of experience in technical product management, ideally in AI, platform, cloud, compute, or infrastructure domains.
  • Experience building, operating, or product-managing large-scale platform infrastructure used by internal or external developers.
  • Experience with public cloud platforms such as AWS, GCP, or Azure, and familiarity with hybrid or multi-cloud architecture.
  • Strong understanding of distributed systems, service-to-service communication, API gateways, Kubernetes, cloud-native architectures, and service reliability.
  • Technical fluency in the tradeoffs involved in operating AI workloads, including latency, throughput, availability, scalability, accelerator utilization, and cost.
  • Familiarity with AI or GenAI systems, LLMs, generative AI, and production requirements.
  • Ability to work cross-functionally with engineering, security, product, and platform organizations.
  • Excellent communication and storytelling skills, with the ability to translate between user needs, business priorities, and technical architecture and influence diverse teams.
  • Degree in Computer Science, Engineering, a related technical discipline, or equivalent practical experience.

Preferred Qualifications

  • Experience with GPU or accelerator infrastructure, HPC workloads, capacity planning, scheduling, or multi-tenant resource management.
  • Experience with AI infrastructure platforms, MLOps, inference or training platforms, model gateways, inference techniques, model-as-a-service offerings, or model optimization.
  • Contributions to open-source infrastructure, AI, or developer ecosystems.
  • Familiarity with financial services or other large-scale, regulated enterprise environments.

Benefits

Benefits and total rewards may include merit increases, incentive compensation for exempt roles, paid holidays, paid time off, medical, dental, vision, short- and long-term disability benefits, a 401(k) match, life insurance, and wellness programs.

More jobs at Bloomberg

Similar jobs