Henkel

Consulting Engineer (Senior)

Posted Jul 1, 2020
Project ID: 2599469
Location
Düsseldorf
Hours/week
40 hrs/week
Timeline
4 months
Starts: Jul 20, 2020
Ends: Nov 19, 2020
Payrate range
Unknown

*Please note: the service contract for this position will not be concluded with Henkel AG & Co. KGaA but with an external party”.


Project name

HDF - Palantir - Data Pipelining


Project description

The service is requested as part Henkel Data Foundation, Palantir project for Adhesive Business. The project has the purpose to build up a comprehensive service for Adhesive business and IT people by combining different Microsoft Azure Services and other tools to provide a data lake with data processing capabilities. Huge datasets from different platforms are managed on this data hub.


Task description

The scope of services includes the following tasks, which are independently performed by the external contractor:

  • Establish robust and performant pipelines using Python, Apache Spark within the Azure environment using Azure Databricks;
  • Implement quality checks on incoming data and perform quality assurance tests on the datasets and code;
  • Analyse business’ requirement in terms of data transformation in a qualitatively diverse data environment;
  • Consult business on best practices and technical effort in relation to product development and project achievements.


The service of the contractor has the goal to build and maintain the technology and data

pipelining.

Similar projects

+ Search all projects