This repository is meant to contain scripts to assist customers moving from Nebula to Astro. See usage instructions below
- Python 3
- Use the command
git clone [email protected]:astronomer/cs-utility-nebula-to-astro.git
to clone this repo - Use the command
cd cs-utility-nebula-to-astro
to change your working directory - Run the
make init
command to generate theairflow-connections.yaml
file - In the
airflow-connections.yaml
update variables to match your Nebula deployment and Astro deployment
- Astro Domain: From the Astronomer UI in the Astro product, this is the URL of your deployment after clicking the
Open Airflow
button (be sure to remove/home
from the end of the URL - Astro Key ID: From the Astronomer UI in the Astro product, this is found in the API Keys section of your deployment
- Astro Key Secret: From the Astronomer UI in the Astro product, this is found in the API Keys section of your deployment
- Nebula API Key: From the Astronomer UI in the Nebula product, this is found under the Service Accounts section
- Nebula Base Domain: From the Astronomer UI in the Nebula product, this is retrievable from the URL shown in your browser. Your URL will have the following format:
https://app.<BASE-DOMAIN>/w/<WORKSPACE-ID>/d/<DEPLOYMENT-RELEASE-NAME>
- Nebula Deployment Release Name: From the Astronomer UI in the Nebula product, this is retrievable from the URL shown in your browser. Your URL will have the following format:
https://app.<BASE-DOMAIN>/w/<WORKSPACE-ID>/d/<DEPLOYMENT-RELEASE-NAME>
After completing the setup section above, you may use the following make commands:
- Use the
make check-providers
command to view which providers are missing in your target environment - Use the
make connections
command to migrate all connections. Please note that this does not migrate the password field. Each migrated connection will require manually adding the password field - Use the
make pools
command to migrate all pools - Use the
make variables
command to migrate all variables