- ๐ Hi, Iโm Sanket Sanap
- ๐ Iโm interested in Big Data, Data Science, Data Engineering and Cloud applications
- ๐ฑ Pursuing Master of Science in Data Architecture and Management
- ๐ซ Reach me at [email protected]
sanketsanap5 / escooter-data-pipeline Goto Github PK
View Code? Open in Web Editor NEWAn Automated data pipeline using "Apache Airflow" performing "ETL" on RAW data using "Pandas" library then stage data into "PostgreSQL" then process it distributed cluster and parallelly using "Spark" and loaded final useful data into "ElasticSearch" NoSQL DB warehouse