Big Data Manager

Description

What do you get out of this Role?

If you want to apply and enhance your expertise in Big Data, develop Scala Pipelines, offer Spark performance solutions interact with Elastic Search, Flume, Kibana, in an environment as vast as Deutsche Bank, this is the right time and job for you.

We use of the latest architectures and technologies in Big Data and Business Intelligence in order to offer relevant data analysis to financial departments and ensure regulatory commitments.

According to Deutsche Bank’s strategic approach – to work with latest innovative solutions, the initial prototypes started to become the norm for many projects.

Responsibilities :

• Lead a team of 10 developers and perform all people manager activities.
• Build distributed, reliable and scalable data pipelines to ingest and process data in real-time. Hadoop developer deals with fetching streams, transaction behaviors, clickstream data and other unstructured data.
• Load data from different datasets and deciding on which file format is efficient for a task. Hadoop developers source large volumes of data from diverse data platforms into Hadoop platform.
• Fine tune Hadoop applications for high performance and throughput.
• Configure and maintain enterprise Hadoop environment.
• Understand the requirements of input to output transformations.
• Defining Hadoop Job Flows / Implement data workflows using Hadoop ecosystem.
• Design and implement column family schemas of Hive / Impala within HDFS.
• Assign schemas and create Hive / Impala tables.
• Develop efficient Hive / Impala scripts with joins on datasets using various techniques.
• Assess the quality of datasets for a Hadoop data lake.
• Troubleshoot and debug any Hadoop ecosystem run time issue.

Skills :

What we offer :

We strive for a in which we are empowered to excel together every day. This includes acting responsibly, thinking commercially, taking initiative and working collaboratively.

Together we share and celebrate the successes of our people. Together we are Deutsche Bank Group.

We welcome applications from all people and promote a positive, fair and inclusive work environment.