AI Operation Lead

The AI Operations Lead contributes hands-on to integration, deployment and monitoring of AI systems such as ML, GenAI, RAG and agentic workflows. The role focuses on a subset of products/services and ensures operational excellence, observability, and performance.

Key duties and responsibilities

• Implement and operate integration of AI capabilities into enterprise products following standard patterns

• Contribute to deployment of:

  RAG pipelines

  Copilots and AI assistants

  Agentic workflows

  Predictive ML services

• Support delivery squads in integrating AI services into business applications

• roubleshoot and resolve integration or runtime issues in production

AI Observability & Monitoring (Core focus)

• Design and implement AI observability frameworks, including: Model performance monitoring (drift, quality, hallucination signals)Usage and adoption metricsLatency, reliability, and system health
• Ensure proper logging, tracing, and monitoring of AI pipelines
• Contribute to definition of AI SLAs/SLOs aligned with business expectations
• Support incident management and post-mortem analysis for AI systems

Cost & Performance Optimization

• Monitor AI-related cloud consumption and inference costs
• Optimize pipelines for efficiency (model selection, caching, orchestration)
• Contribute to FinOps practices specific to AI workloads

Business Acumen

• Understands operational impact of AI systems on business processes

• Able to balance performance, cost, and quality trade-offs

• Communicates effectively with technical and business stakeholders

Required experience & competencies

• 5–8 years in software/ML engineering

• Cloud (Azure), Kubernetes, Python

• Experience with GenAI and ML systems

Technical Skills

• Strong hands-on experience in:

  Python, APIs, microservices architecture

  Cloud environments (Azure preferred, AWS/GCP acceptable)

  Kubernetes and containerized deployments

• Experience with:

  MLOps / LLMOps tooling

  Monitoring/observability tools (e.g., logs, metrics, tracing)

  Data pipelines and distributed systems

• Understanding of:

  GenAI / LLM systems (RAG, embeddings, prompting)

  ML lifecycle and deployment patterns

Soft skills

• Hands-on and problem-solving mindset
• Ability to debug complex AI systems in production
• Strong collaboration with engineering and product teams
• Ability to explain technical issues clearly to non-experts
• Proactive and continuous improvement mindset

Business acumen

• Can adapt his/her speech to make relevant for business users
• Can interact effectively with top management

• Can support in produce presentations or architecture material

  Required Education

• Master’s degree (Ph. D. is a plus) in Science, Technology, Engineering, Computer Science,

• Bachelor’s degree plus ASA or similar work experience is accepted in place of a relevant Master’s degree

• Certifications on Cloud or Microservices or Kubernetes (CKAD) are plus.