Senior Data Engineer

DataBrasov+9 more

What's this role about?

Our client is going through an exciting period of change and is seeking highly motivated and experienced Senior Data Engineer to join their Data Engineering team. You will work as part of an exciting greenfield tech hub covering all facets of technology within their organisation. You will be responsible for end-to-end development on the data platform, including test development, to ensure continued service delivery versus expectations. You will understand all engineering stages for a data platform by providing end-to-end, full-stack data expertise from design to build. You will be a leading member of the team, helping to develop and mentor junior members as well as input into design and architectural decisions. If you're looking for an exciting opportunity to step out of your comfort zone and make a real impact by building better software, this is the job for you!

• Key Responsibilities :
• Work together with data scientists and analysts to understand the needs for data and create effective data workflows
• Solution design, implement, and maintain data pipelines for data ingestion, processing, and transformation using could services and other technologies
• Create and maintain data storage solutions including Azure SQL Database, Azure Data Lake, and Azure Blob Storage.
• Utilizing Azure Data Factory or comparable technologies, create and maintain ETL (Extract, Transform, Load) operations.
• Implementing data validation and cleansing procedures will ensure the quality, integrity, and dependability of the data.
• Improve the scalability, efficiency, and cost-effectiveness of data pipelines.
• Monitoring and resolving data pipeline problems, ensuring consistency and availability of the data.
• Automate tasks and deploy production standard code (with unit testing, continuous integration, versioning

What skills and experience do you need?