This repository is a comprehensive guide for setting up Apache Airflow within Docker containers, allowing you to easily manage, schedule, and monitor your data workflows. The repository also includes example DAGs to help you get started quickly.
- Getting Started
- Prerequisites
- Project Structure
- Setting Up Apache Airflow with Docker
- Example DAGs
- Customization
- Contributing
- License
Before you begin, ensure you have the following prerequisites installed:
- Docker: Install Docker
- Docker Compose: Install Docker Compose
The project structure is organized as follows:
airflow-dockerized-repo/
|- dags/ # Place your custom DAG files here
|- scripts/ # Helper scripts
|- docker-compose.yml # Docker Compose configuration
|- .env # Environment variables
|- README.md # This documentation
git clone https://github.com/your-username/airflow-dockerized-repo.git
cd airflow-dockerized-repo
docker compose up airflow-init
docker compose up -d