Senior Data Engineer

Department: Software

Project Location(s): Remote

Experience: 5+ years in software development

Experience with Data Lake;
Minimum of 5 years working experience as a Software or Data Engineer, working with (AWS) Cloud based solutions;
Previous work experience with Kafka event streaming & subscription;
Experience in working with ETL to data lake stage and with version control systems (Github);
Experience with PySpark, Glue and SQL;
Extensive knowledge and hands-on experience with AWS (AWS CDK, Amazon S3, AWS Glue, Amazon Athena, AWS Lambda, Amazon Redshift) and CDK in Python (Infrastructure as Code);
Previous experience in working with (or in) a CI/CD DevOps team;
Experience with SQL & NoSQL databases, such as AWS RDS, DynamoDB;
Understanding of Agile-Scrum methodology;
Knowledge of data governance, compliance, and security best practices to ensure data is managed and secured in accordance with organization’s policies;
Excellent communication skills, written and spoken in English and preferably Dutch.

Work with CDK stacks in AWS, read Kafka topics and process them further in our Data Lake;
Designing, developing, and optimizing our client data infrastructure;
Create clean and structured data flows, industrialize machine learning models and develop end-to-end automated solutions.

We are looking for a Senior Data Engineer with DevOps skills to join our team in a challenging project in collaboration with one of our clients, the largest courier/post company in the Netherlands. As a Data Engineer, you will play a crucial role in designing, developing, and optimizing our client data infrastructure. Your expertise will be at the core of our primary processes, shaping the way we harness the potential of data to drive
informed decision-making and fuel our client business growth.
The aim of this project is to increase the efficient use of data by storing and analyzing large volumes of data in a cost-effective and scalable way using a Data Lake platform.