Data Engineer – Greater Copenhagen
Deadline: 17/01/2025
Ønsker du at modtage opgaver som denne på mail?
Vær blandt de første til at få besked, når vi har nye freelance konsulentopgaver. Det tager kun et minut at tilmelde dig.
Tilmeld dig her
Beskrivelse
On behalf of our client we are looking for a Data Engineer to arrange and display data from different source systems in a data lake in an AWS cloud. The tasks are to onboard different source systems, extract the data and transform them and apply business rules before they are loaded into the AWS Cloud environment.
The programming takes place in SPARK-pyspark and the analysis of data is performed with SQL. The managing of the code and pipelines is done in Azure DevOps. The consultant must understand data and have knowledge on data lakes and databases. The data engineer works closely together with the business analyst of the project and must have good communication skills to align the requirements with the business analyst and the end users who are pharma scientists and machine learning scientists.
Workplace: Greater Copenhagen (Great flexibility in relation to remote/onsite)
Workload: 100 %
Start: January
Duration: 6 – 9 months
Language: English and Danish
Qualifications:
Following technologies are involved:
-AWS S3
-AWS Glue
-Medallion Architecture Delta lake
-AWS Lambda
-AWS Athena
-Azure DevOps, CI/CD, GIT
-AWS CDK
-SPARK-pyspark
-SQL
Interested?
The send your resume immediately to ucalum@avenida.dk
