AI Operations Engineer

Details

IT Operations at ClickHouse maintains the company’s internal systems, tooling, and infrastructure. This role is part of a newly formed AI Engineering function within IT Operations, focused on the design, deployment, and lifecycle management of AI solutions and agents.

The AI Operations Engineer will work under a Technical Lead to design, build, and maintain AI-driven solutions across business functions such as People, Finance, Legal, and Engineering. The role includes building integrations, maintaining agents, supporting AI cost visibility, and training the organization on AI best practices.

Responsibilities

Build AI-Powered Solutions

• Develop and deploy solutions using LLMs, automation frameworks, and internal tooling for business and engineering use cases.
• Integrate AI with HRIS, ATS, ERP, procurement orchestration, ticketing, CI/CD, developer tooling, CLM, and Matter Management systems.
• Build workflows for document generation, data extraction, knowledge retrieval, and decision support across systems and knowledge bases.
• Use modern integration standards such as MCP to provide AI models and agents with secure access to internal knowledge and context.

Support Model Evaluation

• Test and benchmark AI models against accuracy, latency, cost, and safety criteria.
• Support model risk assessments and due diligence with Security and GRC teams.
• Help implement and maintain the internal model-routing solution.

Support Cost Visibility

• Build dashboards and reporting for AI and LLM spend across teams and tools.
• Implement tagging, monitoring, and alerting for cost anomalies.
• Identify and execute cost-optimization opportunities involving prompt efficiency, caching, and model right-sizing.

Maintain Agent Infrastructure

• Provision, credential, and de-provision AI agent access.
• Support agent deployment, versioning, monitoring, and retirement.
• Maintain and patch agent infrastructure and dependencies.
• Maintain audit trails and logging for agent actions.

Deliver Training and Enablement

• Design and deliver company-wide AI training for non-technical business users and engineers.
• Create playbooks, guides, templates, and reusable components for safe and effective AI adoption.
• Run onboarding sessions, office hours, and workshops to build AI fluency and encourage adoption of approved tools and agents.
• Establish feedback loops to improve training content, tooling, and documentation.

Requirements

• Experience building with modern AI and machine learning tools and frameworks.
• Experience building and consuming APIs, developing data pipelines, and architecting system integrations.
• Working knowledge of cloud infrastructure such as AWS, GCP, or Azure, with experience hosting or operating production services.
• Experience comparing and evaluating AI models across providers, including trade-offs between cost, latency, and quality.
• Comfort working with usage and billing data for cost visibility, forecasting, or optimization.
• Ability to understand business and engineering workflows and translate them into technical solutions.
• Experience working with or integrating business systems and engineering or developer tooling.
• Experience creating training materials, documentation, or workshops for mixed technical and non-technical audiences.
• Understanding of data privacy, security, and compliance considerations.
• Experience implementing AI safeguards, including identity and access controls for automated or non-human actors.

Benefits

• Flexible, remote-friendly work environment at a globally distributed company operating in more than 25 countries.
• Employer healthcare contributions.
• Stock options for every new team member.
• Flexible time off in the United States and generous entitlement in other countries.
• USD 500 home office setup allowance for remote employees.
• Opportunities to participate in company-wide global gatherings.

ClickHouse is an equal opportunity employer and prohibits discrimination and harassment. The company provides privacy information in its Applicant Privacy Notice.