Team Leader - Annotations Operations and Governance

Details

Bloomberg's Data organization delivers data, news, and analytics through innovative technology. The Data AI group brings innovative AI technologies into Bloomberg's Data organization, contributing financial domain expertise to AI-powered products and improving data workflows, quality, intelligence, and usability.

The Team Leader will own and scale Bloomberg's annotation function across AI and data initiatives, covering Annotation Operations and Annotation Standards & Governance. The role leads the governance of canonical annotation standards and judgment frameworks, as well as their operational application through SME-driven workflows, vendor execution, quality control, and continuous improvement.

The role operates annotation as a shared service across Data AI teams. Responsibilities include ensuring that schemas, labels, ambiguity frameworks, and calibration rules are consistently and correctly applied in production, while using metrics to detect drift, diagnose failure modes, and improve data quality. The position supports training, evaluation, monitoring, and production AI systems.

Responsibilities

• Lead and develop a team responsible for operating and governing Bloomberg's AI data annotation capability.
• Own annotation operations end-to-end, translating schemas and judgment frameworks into scalable workflows with measurable quality.
• Establish governance and quality mechanisms, including calibration, agreement analysis, and drift detection.
• Partner with AI, Data, and Platform teams to align annotation outputs with production needs and downstream model requirements.
• Manage workforce strategy, vendor oversight, capacity planning, and service reliability.
• Drive continuous improvement through metrics, feedback loops, and root-cause analysis.
• Maintain judgment integrity, high agreement, and durable decision-making frameworks as models and domains evolve.

Requirements

• Prior people leadership experience, including leading operational or program-focused teams.
• Demonstrated technical judgment in designing or operating annotation systems supporting machine learning training, evaluation, or model assessment.
• Strong understanding of annotation systems and quality methodologies, including calibration, agreement modeling, and drift detection.
• Proven experience running large-scale annotation or data operations with vendor and SME workforces.
• Ability to enforce centrally defined standards while maintaining consistency at scale.
• Excellent cross-functional leadership skills and comfort operating in ambiguity-rich environments.
• Strong program leadership capability focused on measurable outcomes and continuous improvement.
• Bachelor's or Master's degree in a relevant field, or equivalent practical experience.

Preferred Qualifications

• Experience supporting machine learning training, evaluation, or monitoring pipelines.
• Familiarity with annotation platforms, quality assurance tooling, and data instrumentation.

Compensation and Benefits

• Salary: USD 135,000–230,000 annually.
• Benefits and bonus may include merit increases, incentive compensation for exempt roles, paid holidays, paid time off, medical, dental, vision, short- and long-term disability benefits, 401(k) matching, life insurance, and wellness programs.