This job offer is not available in your country.

Kafka DevOps Engineer - Senior Consultant / Manager (f / m / d)

MHP - A Porsche CompanyCluj, Romania

9 days ago

Job description

TasksTasks

Manage and operate the Kafka streaming platform using Confluent SaaS, ensuring high availability, scalability, and performance of the messaging infrastructure
Design, implement, and maintain infrastructure as code (IaC) for the provisioning and configuration of Kafka environments using tools such as Terraform or similar
Monitor and troubleshoot Kafka clusters and components
Collaborate with integration platform teams to ensure seamless and secure Kafka topic creation, subscription, and management workflows within the DeveloperHub portal
Develop and maintain automation scripts and pipelines to support Kafka lifecycle management and improve operational efficiency
Support customer-facing self-service capabilities
Implement and enforce security policies and access controls
Work closely with development, product, and support teams to gather requirements, design solutions, and provide expert guidance on best practices

QualificationsQualifications

Must haves :

Apache Kafka Expertise : Deep understanding of Kafka architecture and internal workings, including topics, partitions, brokers, producers, consumers, and Kafka streams

Streaming architecture : The ability to design, implement, and optimize streaming applications using Kafka, AWS, Kubernetes, GitOps, and other relevant technologies and tools

API Development / Integration : Ability to develop and integrate APIs for publishing and subscribing to streaming data. Experience with RESTful service patterns and event-driven architecture

Streaming Data Processing : Understanding of stream processing principles and the ability to design and implement real-time data processing pipelines

Cloud Services Proficiency : Proficient in cloud platforms like AWS and Azure, including their managed Kafka services if available (e.g., Amazon MSK, Azure Event Hubs)

Infrastructure as Code (IaC) : Skills in using tools like Terraform or AWS CloudFormation to define and provision the cloud infrastructure in a repeatable and consistent manner

Good to have :

Confluent Platform Knowledge : Familiarity with the Confluent SaaS offering, including setting up and managing Kafka clusters, schema registry, Kafka Connect, and ksqlDB, as well as understanding Confluent's specific tooling and features

Code quality : The ability to ensure the quality, reliability, and security of the code and the product increments delivered by the team, using best practices such as code reviews, testing, and monitoring

Containers and Orchestration : Knowledge of containerization with Docker and orchestration with Kubernetes, potentially including cloud services like AWS EKS or Azure AKS

Devops culture : The ability to foster a culture of collaboration, automation, and continuous improvement among the devops team and the stakeholders

DevOps Practices : Experience with continuous integration and delivery (CI / CD) pipelines, automated testing, and infrastructure monitoring / logging

Security : Understanding of security best practices related to streaming data, such as encryption in transit and at rest, role-based access control, and compliance standards

Monitoring and Alerting : Skills in setting up monitoring, alerting, and logging for Kafka and the applications using it, possibly with tools like Prometheus, Grafana, ELK stack, or cloud-specific monitoring tools

Performance Tuning : Ability to diagnose and resolve bottlenecks in the streaming platform, tuning Kafka configurations for optimal performance

Troubleshooting : Efficient problem-solving skills for diagnosing and resolving issues that may arise during design, deployment, or operation stages

Scripting and Automation : Capability to write scripts in languages like Python, Bash, or PowerShell to automate repetitive tasks and deployments

Problem-solving : The ability to troubleshoot, debug, and resolve issues that arise in the streaming platform, using analytical and creative thinking

Communication and Collaboration : Good communication skills for collaborating with other team members, including developers, IT operations, QA testers, and business stakeholders. Knowledge of and participation in all the agile ceremonies

Documentation : Ability to document technical procedures, configurations, and architectures effectively for knowledge sharing and future reference

Learning and Adaptability : Staying current with emerging trends in streaming technologies, cloud services, and DevOps methodologies, and adapting to new tools as necessary. Having interest and experience with IaC is a plus one

Things to know before departure :

Start : by arrangement - always on the 1st and th of the month

Working hours : full-time (h); vacation days

Employment contract : CIM, Unlimited

Line of work : Consulting

Language skills : Fluency in written and spoken English

Flexibility & willingness to travel

Other : a valid work permit

Create a job alert for this search

Senior Engineer • Cluj, Romania