magantivenkat / spark_etl_pipeline Goto Github PK
View Code? Open in Web Editor NEWThis project forked from rrctx/spark_etl_pipeline
This repository contains a stripped down version of a batch ETL data pipeline using Apache Airflow, PySpark, Docker, and AWS (S3, EMR, and Redshift).
License: Apache License 2.0