dataalchemisttech Goto Github PK

data-engineering-nanodegree

Projects done in the Data Engineering Nanodegree by Udacity.com

data-engineering-with-aws

Resources and projects from Udacity Data Engineering with AWS nano degree programme

data-engineering-zoomcamp

Free Data Engineering course!

data-science-on-gcp

Source code accompanying book: Data Science on the Google Cloud Platform, Valliappa Lakshmanan, O'Reilly 2017

data-science-question-answer

A repo for data science related questions and answers

dataalchemisttech.github.io

This is my porfolio website.

dataengg-covid19-aws

Data Engineering Project on COVID-19 DataLake by AWS

dataengineeringproject

Example end to end data engineering project.

dataform

Dataform is a framework for managing SQL based data operations in BigQuery, Snowflake, and Redshift

dataform-example-project-bigquery

dataform-example-project-snowflake

dbt-common-utils-demo

dbt-test-demos

df-ml-anomaly-detection

Streaming Anomaly Detection Solution by using Pub/Sub, Dataflow, BQML & Cloud DLP

distance-metrics

Distance metrics are one of the most important parts of some machine learning algorithms, supervised and unsupervised learning, it will help us to calculate and measure similarities between numerical values expressed as data points

dlt

data load tool (dlt) is an open source Python library that makes data loading easy 🛠️

docker-livy

Dockerizing and Consuming an Apache Livy environment

docker-spark

Apache Spark docker image

docker_simulation_pipeline_example

This is an example project to demonstrate how one can easily scale simulation runs with docker containers

dropout-students-prediction

The goal of this project is to identify students at risk of dropping out the school

dukeids706_ds655_individualproject03

Databricks ETL (Extract Transform Load) Pipeline

ethereum-etl-airflow

Airflow DAGs for exporting, loading, and parsing the Ethereum blockchain data. How to get any Ethereum smart contract into BigQuery https://towardsdatascience.com/how-to-get-any-ethereum-smart-contract-into-bigquery-in-8-mins-bab5db1fdeee

etl

[READ-ONLY] PHP - ETL (Extract Transform Load) data processing library

etljob

Simple ETL pipeline using Python

finnhub-streaming-data-pipeline

Stream processing pipeline from Finnhub websocket using Spark, Kafka, Kubernetes and more

flutterflow-attendanceapp

goodreads

:snake: Python wrapper for Goodreads API :books:

goodreads_etl_pipeline

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

gspread-pandas

A package to easily open an instance of a Google spreadsheet and interact with worksheets through Pandas DataFrames.

hadoop-books

This is my personal collection of free Hadoop books, please feel free to share and learn.