derickalex's Projects
In this project, an ETL is developed via using AWS Services such as S3,Lambda,Glue Jobs etc.
A datawarehouse was created to store data of Vehicle Accidents. Before the data was loaded to the data warehouse, the data was loaded into a staging phase and necessary transformations were done.
In this project, I Built an ETL(Extract,Transform,Load) pipeline using the Spotify API. The pipeline will retrieve data from the spotify API, transformed it to a desired format and load data at the end.
The main goal of this project was to get familiar with new Data engineering tool such as Mage for orchestration. The cloud platform which was used to complete this project successfully is GCP.