lilianatang Goto Github PK

395labw18tues

artificial-intelligence---common-lisp

assetoptimization

automating-data-pipeline-with-airflow

Building high grade data pipelines that are dynamic and built from reusable tasks, can be monitored, and allow easy backfills.

building-aws-cloud-data-warehouse

A music streaming startup has grown their user base and song database and want to move their processes and data onto the cloud. Their data resides in S3, in a directory of JSON logs on user activity on the app, as well as a directory with JSON metadata on the songs in their app. As their data engineer, I am tasked with building an ETL pipeline that extracts their data from S3, stages them in Redshift, and transforms data into a set of dimensional tables for their analytics team to continue finding insights in what songs their users are listening to.

building-aws-data-lake

Building an ETL pipeline for a data lake hosted on S3

cdataentityframework

data-dashboard-deployment

Writing Python code that reads in data, cleans the data, and then uses the data to make Plotly visualizations.

data-engineering-workshop

data-modelling-with-apache-cassandra

Modelling event data to create a non-relational database and ETL pipeline for a music streaming app - defining queries & tables for a database built using Apache Cassandra.

data-modelling-with-postgresql

Modelling user activity data to create a database and ETL pipeline in Postgres for a music streaming app - defining Fact & Dimension tables as well as inserting data into new tables.

data-science-in-real-estate

An exploratory data analysis to understand the real estate market in Edmonton.

databricks-for-construction

databricks-for-public-sector

databricks-iot-demo

databricks-nutter-repos-demo

Demo of using the Nutter for testing of Databricks notebooks in the CI/CD pipeline

databricksedmontonusergroup

disaster_response_pipeline_project

Building a machine learning pipeline to categorize emergency messages based on the needs communicated by the sender

dsnd_term2

Contains files related to content and project of DSND Term 2

edmonton-usergroup

entrepreneurship-and-real-estate

getgo

Education Entry Planner

getgo-v13

getgo-ver1

lakehouse-semi-structured-data

lakehouseinagriculture

mlops_manufacturing

oee_dlt

public-datasets

Storing public datasets

sales-forecasting-predictive-models

time series forecasting tool to predict future weekly, monthly, and yearly revenue trends.