AI Operations Engineer

Summary

ClickHouse is a globally distributed company whose IT Operations team manages internal systems, tooling, and infrastructure securely and efficiently. The AI Operations Engineer will help establish a new AI Ops function by designing, deploying, integrating, evaluating, and maintaining AI-driven solutions and agents across business and engineering teams, while supporting cost visibility, governance, and organization-wide AI training.

Responsibilities

• Develop and deploy solutions using LLMs, automation frameworks, and internal tooling, for both business and engineering use cases
• Integrate AI into existing systems (HRIS, ATS, ERP, procurement orchestration, ticketing, CI/CD, developer tooling) and legal infrastructure like CLM or Matter Management
• Build workflows such as document generation, data extraction, knowledge retrieval, and decision support across systems and knowledge bases
• Use modern integration standards (e.g., MCP) to give AI models and agents direct, secure access to internal knowledge and context
• Help test and benchmark AI models against accuracy, latency, cost, and safety criteria
• Support model risk assessments and due diligence alongside Security and GRC
• Help implement and maintain the internal model routing solution
• Help build dashboards and reporting for AI/LLM spend across teams and tools
• Implement tagging, monitoring, and alerting for cost anomalies
• Identify and execute on cost-optimization opportunities (prompt efficiency, caching, model right-sizing)
• Help provision, credential, and de-provision AI agent access
• Support deployment, versioning, monitoring, and retirement of agents
• Maintain and patch agent infrastructure and dependencies
• Help maintain audit trails and logging for agent actions
• Design and deliver company-wide AI training programs tailored to different audiences — non-technical business users through engineers
• Create lightweight playbooks, guides, templates, and reusable components for safe, effective AI adoption
• Run onboarding sessions, office hours, and workshops to build AI fluency and drive adoption of approved tools and agents
• Establish a feedback loop with users to continuously improve training content, tooling, and documentation

Skills

• Experience building with modern AI/ML tools and frameworks
• Experience building and consuming APIs, developing data pipelines, and architecting system integrations
• Working knowledge of cloud infrastructure (AWS, GCP, or Azure) and experience hosting or operating services in production
• Experience comparing and evaluating AI models across providers, including trade-offs between cost, latency, and quality
• Comfort working with usage and billing data to build cost visibility, forecasting, or optimization
• Ability to understand both business and engineering workflows and translate them into technical solutions
• Experience working with or integrating business systems as well as engineering/developer tooling
• Experience creating training materials, documentation, or workshops for mixed technical/non-technical audiences
• Understanding of data privacy, security, and compliance considerations
• Experience implementing safeguards in AI systems, including identity and access controls for automated/non-human actors

Qualifications

Must Haves

• Experience building with modern AI/ML tools and frameworks
• Experience building and consuming APIs, developing data pipelines, and architecting system integrations
• Working knowledge of cloud infrastructure (AWS, GCP, or Azure) and experience hosting or operating services in production
• Experience comparing and evaluating AI models across providers, including trade-offs between cost, latency, and quality
• Comfort working with usage and billing data to build cost visibility, forecasting, or optimization
• Ability to understand both business and engineering workflows and translate them into technical solutions
• Experience working with or integrating business systems as well as engineering/developer tooling
• Experience creating training materials, documentation, or workshops for mixed technical/non-technical audiences
• Understanding of data privacy, security, and compliance considerations
• Experience implementing safeguards in AI systems, including identity and access controls for automated/non-human actors

Benefits

• Flexible work environment - ClickHouse is a globally distributed company and remote-friendly. We currently operate in over 25 countries.
• Healthcare - Employer contributions towards your healthcare.
• Equity in the company - Every new team member who joins our company receives stock options.
• Time off - Flexible time off in the US, generous entitlement in other countries.
• A USD$500 Home office setup if you’re a remote employee.
• Global Gatherings – We believe in the power of in-person connection and offer opportunities to engage with colleagues at company-wide offsites.