How to create a ETL service tutorial. Reference: https://medium.com/plumbersofdatascience/etl-rest-api-using-python-flask-c8171ac925c5

1. Create and source conda env

$ conda env create -f environment.yml
$ conda activate etl-api

Note: After env creation, the terminal may need to be restarted for the env to be activated.

2. Use the Makefile to upgrade pip and to install the dependencies from the requirements.txt file

$ make install

1. Execute the setup.py script using the following command:

$ python setup.py bdist_wheel

The postgres container initialize a virtual db to execute tests in the app isolated from a local env. To spin the container follow the instructions below:

1. Setup an external volume

$ docker volume create dbname

2. Launch Postgres DB

$ docker-compose up -d