Talent.com
This job offer is not available in your country.
Kafka DevOps Engineer - Senior Consultant / Manager (f / m / d)

Kafka DevOps Engineer - Senior Consultant / Manager (f / m / d)

MHP - A Porsche CompanyTimisoara, Romania
9 days ago
Job description

TasksTasks

  • Manage and operate the Kafka streaming platform using Confluent SaaS, ensuring high availability, scalability, and performance of the messaging infrastructure
  • Design, implement, and maintain infrastructure as code (IaC) for the provisioning and configuration of Kafka environments using tools such as Terraform or similar
  • Monitor and troubleshoot Kafka clusters and components
  • Collaborate with integration platform teams to ensure seamless and secure Kafka topic creation, subscription, and management workflows within the DeveloperHub portal
  • Develop and maintain automation scripts and pipelines to support Kafka lifecycle management and improve operational efficiency
  • Support customer-facing self-service capabilities
  • Implement and enforce security policies and access controls
  • Work closely with development, product, and support teams to gather requirements, design solutions, and provide expert guidance on best practices

QualificationsQualifications

Must haves :

  • Apache Kafka Expertise : Deep understanding of Kafka architecture and internal workings, including topics, partitions, brokers, producers, consumers, and Kafka streams
  • Streaming architecture : The ability to design, implement, and optimize streaming applications using Kafka, AWS, Kubernetes, GitOps, and other relevant technologies and tools
  • API Development / Integration : Ability to develop and integrate APIs for publishing and subscribing to streaming data. Experience with RESTful service patterns and event-driven architecture
  • Streaming Data Processing : Understanding of stream processing principles and the ability to design and implement real-time data processing pipelines
  • Cloud Services Proficiency : Proficient in cloud platforms like AWS and Azure, including their managed Kafka services if available (e.g., Amazon MSK, Azure Event Hubs)
  • Infrastructure as Code (IaC) : Skills in using tools like Terraform or AWS CloudFormation to define and provision the cloud infrastructure in a repeatable and consistent manner
  • Good to have :

  • Confluent Platform Knowledge : Familiarity with the Confluent SaaS offering, including setting up and managing Kafka clusters, schema registry, Kafka Connect, and ksqlDB, as well as understanding Confluent's specific tooling and features
  • Code quality : The ability to ensure the quality, reliability, and security of the code and the product increments delivered by the team, using best practices such as code reviews, testing, and monitoring
  • Containers and Orchestration : Knowledge of containerization with Docker and orchestration with Kubernetes, potentially including cloud services like AWS EKS or Azure AKS
  • Devops culture : The ability to foster a culture of collaboration, automation, and continuous improvement among the devops team and the stakeholders
  • DevOps Practices : Experience with continuous integration and delivery (CI / CD) pipelines, automated testing, and infrastructure monitoring / logging
  • Security : Understanding of security best practices related to streaming data, such as encryption in transit and at rest, role-based access control, and compliance standards
  • Monitoring and Alerting : Skills in setting up monitoring, alerting, and logging for Kafka and the applications using it, possibly with tools like Prometheus, Grafana, ELK stack, or cloud-specific monitoring tools
  • Performance Tuning : Ability to diagnose and resolve bottlenecks in the streaming platform, tuning Kafka configurations for optimal performance
  • Troubleshooting : Efficient problem-solving skills for diagnosing and resolving issues that may arise during design, deployment, or operation stages
  • Scripting and Automation : Capability to write scripts in languages like Python, Bash, or PowerShell to automate repetitive tasks and deployments
  • Problem-solving : The ability to troubleshoot, debug, and resolve issues that arise in the streaming platform, using analytical and creative thinking
  • Communication and Collaboration : Good communication skills for collaborating with other team members, including developers, IT operations, QA testers, and business stakeholders. Knowledge of and participation in all the agile ceremonies
  • Documentation : Ability to document technical procedures, configurations, and architectures effectively for knowledge sharing and future reference
  • Learning and Adaptability : Staying current with emerging trends in streaming technologies, cloud services, and DevOps methodologies, and adapting to new tools as necessary. Having interest and experience with IaC is a plus one
  • Things to know before departure :

  • Start :   by arrangement - always on the 1st and th of the month
  • Working hours :   full-time (h); vacation days
  • Employment contract :   CIM, Unlimited
  • Line of work :   Consulting
  • Language skills :   Fluency in written and spoken English
  • Flexibility & willingness to travel
  • Other :   a valid work permit
  • Create a job alert for this search

    Senior Engineer • Timisoara, Romania