Big Data Engineer Senior

Start Date: ASAP

Duration: Until December 2023 (with possible extension)

Working Location: Remote

Role Description:

We are currently seeking a skilled Big Data Engineer to join our team. As a senior member, you will be responsible for working on a Compliance DataMart project that utilizes Hadoop Cloudera. The DataMart serves as a central data hub, supporting various compliance use cases to identify fraud in customer transactions. The logic is implemented in pyspark and integrates with the surrounding solution through files and Kafka.

Key Responsibilities:

• Develop new features and make necessary changes to the Compliance DataMart
• Perform data preparation and support data scientists
• Implement ETL (Extract, Transform, Load) processes for the Compliance DataMart
• Utilize Cloudera, Spark, and Bash for the implementation of ETLs

Job Requirements:

• Strong experience in developing and implementing ETL processes for data platforms
• Proficiency in Cloudera and Spark
• Familiarity with Bash scripting
• Knowledge of big data technologies and frameworks
• Understanding compliance and fraud detection concepts is a plus

Language Requirements:

• Fluent English (professional level)
• German language skills are advantageous

Note: This is a senior-level position requiring expertise in Big Data Engineering and experience working with Cloudera, Spark, and ETL processes. The project is expected to continue until December 2023, with the possibility of an extension. The role offers the flexibility of remote work.