Technical Product Manager - GenAI Platforms - AI Infrastructure - CTO Office
Tech Stack
Tag name is followed by "@" symbol and proficiency level value.
About proficiency levels:
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
AI @ 3
API @ 6
AWS @ 2
Azure @ 2
Communication @ 6
Distributed Systems @ 6
GCP @ 2
GPU @ 3
GenAI @ 2
Generative AI @ 2
HPC @ 3
Kubernetes @ 6
LLM
MLOps @ 3
Networking
Product Management @ 5
Security @ 3
System Architecture
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Details
Bloomberg’s CTO Office is the future-looking technical and product arm of Bloomberg L.P., working across AI platforms, cloud infrastructure, open-source stewardship, and generative AI innovation.
The role focuses on defining and executing foundational AI infrastructure capabilities across cloud, compute, data, networking, and runtime environments. This includes enabling teams to experiment with, access, deploy, serve, evaluate, govern, and operate AI models across diverse infrastructure environments.
Responsibilities
- Define and drive the vision for Bloomberg’s AI Infrastructure across models, compute, and cloud.
- Work with AI product and engineering teams to understand requirements for model quality, performance, scale, reliability, and cost, and translate common needs into reusable platform capabilities.
- Partner with engineering to deliver scalable and resilient system architecture.
- Advance hybrid and multi-cloud capabilities, including portability, resilience, scalability, and integration with model and cloud providers.
- Evaluate cloud platforms, model providers, infrastructure services, model-serving technologies, accelerators, and emerging AI infrastructure capabilities, translating them into platform opportunities and roadmap decisions.
- Establish product metrics and strategies for improving latency, throughput, availability, utilization, capacity, and cost efficiency across AI workloads.
- Align priorities, dependencies, and investments across AI Platforms, Cloud, Security, Engineering, Product, and other infrastructure organizations.
- Anticipate the evolution of AI workloads and infrastructure requirements while balancing standardization, paved paths, flexibility, and choice.
Requirements
- 5+ years of experience in technical product management, ideally in AI, platform, cloud, compute, or infrastructure domains.
- Experience building, operating, or product-managing large-scale platform infrastructure used by internal or external developers.
- Experience with public cloud platforms such as AWS, GCP, or Azure, and familiarity with hybrid or multi-cloud architecture.
- Strong understanding of distributed systems, service-to-service communication, API gateways, Kubernetes, cloud-native architectures, and service reliability.
- Technical fluency in the tradeoffs involved in operating AI workloads, including latency, throughput, availability, scalability, accelerator utilization, and cost.
- Familiarity with AI or GenAI systems, LLMs, generative AI, and production requirements.
- Ability to work cross-functionally with engineering, security, product, and platform organizations.
- Excellent communication and storytelling skills, with the ability to translate between user needs, business priorities, and technical architecture and influence diverse teams.
- Degree in Computer Science, Engineering, a related technical discipline, or equivalent practical experience.
Preferred Qualifications
- Experience with GPU or accelerator infrastructure, HPC workloads, capacity planning, scheduling, or multi-tenant resource management.
- Experience with AI infrastructure platforms, MLOps, inference or training platforms, model gateways, inference techniques, model-as-a-service offerings, or model optimization.
- Contributions to open-source infrastructure, AI, or developer ecosystems.
- Familiarity with financial services or other large-scale, regulated enterprise environments.
Benefits
Benefits and total rewards may include merit increases, incentive compensation for exempt roles, paid holidays, paid time off, medical, dental, vision, short- and long-term disability benefits, a 401(k) match, life insurance, and wellness programs.