jaiswalanshul Goto Github PK

airflow

This repository contains the exercises and solutions for the Data Pipelines course

airflow-training

Introduction to the data pipeline management with Airflow. Airflow schedule and maintain numerous ETL processes running on a large scale Enterprise Data Warehouse

airflow_example

DAG examples from official Airflow documents

awesome-apache-airflow

Curated list of resources about Apache Airflow

awesome-azure-learning

This repo includes plenty of references for Azure learning, especially for the Azure certs and Azure architecture, and any other learning materials e.g. security and automation topics.

awesome-data-engineering

A curated list of data engineering tools for software developers

azure-data-factory-for-data-engineers---project-on-covid19

Built a data ingestion pipeline in Azure Data lake to Visualize Countries With Highest Corona Virus Hospital Admissions Using Azure Data Factory(ADF), Azure Data Studio, Azure Data Lake Storage Gen2, Azure SQL Database, Azure Blob Storage, Dataflow, Data Brick Transformation and Hd-insight

azure-databricks-nyc-taxi-workshop

An Azure Databricks workshop leveraging the New York Taxi and Limousine Commission Trip Records dataset

azuredatafactoryhol

Azure Data Factory Hands On Lab - Step by Step - A Comprehensive Azure Data Factory and Mapping Data Flow step by step tutorial

azuredevopslabs

Learn how you can plan smartly, collaborate better, and ship faster with a set of modern development services with Azure DevOps.

big-data-analytics-with-pyspark

Big Data Analytics with PySpark

charts

ckad-exam

Exercises get you ready for the Certified Kubernetes Application Developer exam

ckad-notes

Notes to help you pass the CKAD exam

ckad-practice-questions

This is a consolidated list for CKAD practice questions

ckadpractice-questions

CKAD-Practice-Questions

cloud-composer-examples

This repo constains the following examples of using Cloud Composer, Google Cloud Platform's managed Apache Airflow service:

cookbook

The Data Engineering Cookbook

data-pipelines-with-airflow

In this project, we will orchestrate our Data Pipeline workflow using an open-source Apache project called Apache Airflow. We will schedule our ETL jobs in Airflow, create project related custom plugins and operators and automate the pipeline execution.

data-pipelines-with-apache-airflow

Data Pipelines with Apache Airflow

databricks-certified-associate-developer

Databricks Certified Associate Developer - Apache Spark 2022

devops-master-class

Devops Tutorial - Docker, Kubernetes, Terraform, Ansible, Jenkins and Azure Devops

django_realestate

django_realestate

dp-200-implementing-an-azure-data-solution

etl-datawarehouse-workshop

ETL workshop using the famous Sakila database schema

gcp_dataproc_spark_airflow

Data Workflows with GCP Dataproc, Apache Airflow and Apache Spark

gke-logging-sinks-demo

This project describes the steps required to deploy a sample application to Kubernetes Engine that forwards log events to Stackdriver Logging. As a part of the exercise, you will create a Cloud Storage bucket and a BigQuery dataset for exporting log data.

kuberenetes-kubectl-cheatsheet

Kubernetes or Kubectl cheatsheet.

kubernetes-fundamentals

Kubernetes Fundamentals

modern-data-warehouse-dataops

DataOps for the Modern Data Warehouse on Microsoft Azure