faridfarab Goto Github PK

airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.

airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

alembic

A database migrations tool for SQLAlchemy.

amazingpython

apachekafkaseriesv3

Work with Apache Kafka Udemy course for Kafka Version 3.x

awesome-for-beginners

A list of awesome beginners-friendly projects.

celery

Distributed Task Queue (development branch)

chatterbot

ChatterBot is a machine learning, conversational dialog engine for creating chat bots

chevron

A Python implementation of mustache

cp-all-in-one

docker-compose.yml files for cp-all-in-one , cp-all-in-one-community, cp-all-in-one-cloud, Apache Kafka Confluent Platform

data-diff

Compare tables within or across databases

data-engineer-roadmap

Roadmap to becoming a data engineer in 2021

data-engineering-roadmap

datahub

The Metadata Platform for the Modern Data Stack

datahub-actions

DataHub Actions is a framework for responding to changes to your DataHub Metadata Graph in real time.

devops-exercises

Linux, Jenkins, AWS, SRE, Prometheus, Docker, Python, Ansible, Git, Kubernetes, Terraform, OpenStack, SQL, NoSQL, Azure, GCP, DNS, Elastic, Network, Virtualization. DevOps Interview Questions

edgedb

A graph-relational database with declarative schema, built-in migration system, and a next-generation query language

fastapi

faststream

FastStream is a powerful and easy-to-use Python framework for building asynchronous services interacting with event streams such as Apache Kafka, RabbitMQ, NATS and Redis.

fiona

Fiona reads and writes geographic data files

great_expectations

Always know what to expect from your data.

jinja

A very fast and expressive template engine.

lastnews

A simple flask api project for student with sqlite.

locust

Write scalable load tests in plain Python 🚗💨

luigi

Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

mage-ai

🧙 Build, run, and manage data pipelines for integrating and transforming data.

mastering-kafka-streams-and-ksqldb

Code repository for the Mastering Kafka Streams and ksqlDB book

peewee

a small, expressive orm -- supports postgresql, mysql, sqlite and cockroachdb

ploomber

The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️

projecteuler

Solving Project Euler problems.