TasksTasks
- Manage and operate the Kafka streaming platform using Confluent SaaS, ensuring high availability, scalability, and performance of the messaging infrastructure
- Design, implement, and maintain infrastructure as code (IaC) for the provisioning and configuration of Kafka environments using tools such as Terraform or similar
- Monitor and troubleshoot Kafka clusters and components
- Collaborate with integration platform teams to ensure seamless and secure Kafka topic creation, subscription, and management workflows within the DeveloperHub portal
- Develop and maintain automation scripts and pipelines to support Kafka lifecycle management and improve operational efficiency
- Support customer-facing self-service capabilities
- Implement and enforce security policies and access controls
- Work closely with development, product, and support teams to gather requirements, design solutions, and provide expert guidance on best practices
QualificationsQualifications
Must haves :
Apache Kafka Expertise : Deep understanding of Kafka architecture and internal workings, including topics, partitions, brokers, producers, consumers, and Kafka streamsStreaming architecture : The ability to design, implement, and optimize streaming applications using Kafka, AWS, Kubernetes, GitOps, and other relevant technologies and toolsAPI Development / Integration : Ability to develop and integrate APIs for publishing and subscribing to streaming data. Experience with RESTful service patterns and event-driven architectureStreaming Data Processing : Understanding of stream processing principles and the ability to design and implement real-time data processing pipelinesCloud Services Proficiency : Proficient in cloud platforms like AWS and Azure, including their managed Kafka services if available (e.g., Amazon MSK, Azure Event Hubs)Infrastructure as Code (IaC) : Skills in using tools like Terraform or AWS CloudFormation to define and provision the cloud infrastructure in a repeatable and consistent mannerGood to have :
Confluent Platform Knowledge : Familiarity with the Confluent SaaS offering, including setting up and managing Kafka clusters, schema registry, Kafka Connect, and ksqlDB, as well as understanding Confluent's specific tooling and featuresCode quality : The ability to ensure the quality, reliability, and security of the code and the product increments delivered by the team, using best practices such as code reviews, testing, and monitoringContainers and Orchestration : Knowledge of containerization with Docker and orchestration with Kubernetes, potentially including cloud services like AWS EKS or Azure AKSDevops culture : The ability to foster a culture of collaboration, automation, and continuous improvement among the devops team and the stakeholdersDevOps Practices : Experience with continuous integration and delivery (CI / CD) pipelines, automated testing, and infrastructure monitoring / loggingSecurity : Understanding of security best practices related to streaming data, such as encryption in transit and at rest, role-based access control, and compliance standardsMonitoring and Alerting : Skills in setting up monitoring, alerting, and logging for Kafka and the applications using it, possibly with tools like Prometheus, Grafana, ELK stack, or cloud-specific monitoring toolsPerformance Tuning : Ability to diagnose and resolve bottlenecks in the streaming platform, tuning Kafka configurations for optimal performanceTroubleshooting : Efficient problem-solving skills for diagnosing and resolving issues that may arise during design, deployment, or operation stagesScripting and Automation : Capability to write scripts in languages like Python, Bash, or PowerShell to automate repetitive tasks and deploymentsProblem-solving : The ability to troubleshoot, debug, and resolve issues that arise in the streaming platform, using analytical and creative thinkingCommunication and Collaboration : Good communication skills for collaborating with other team members, including developers, IT operations, QA testers, and business stakeholders. Knowledge of and participation in all the agile ceremoniesDocumentation : Ability to document technical procedures, configurations, and architectures effectively for knowledge sharing and future referenceLearning and Adaptability : Staying current with emerging trends in streaming technologies, cloud services, and DevOps methodologies, and adapting to new tools as necessary. Having interest and experience with IaC is a plus oneThings to know before departure :
Start : by arrangement - always on the 1st and th of the monthWorking hours : full-time (h); vacation daysEmployment contract : CIM, UnlimitedLine of work : ConsultingLanguage skills : Fluency in written and spoken EnglishFlexibility & willingness to travelOther : a valid work permit