Comments (7)
Hey @pedromachados, we'll be updating the docs soon. We are in the process of moving some of this functionality to our CLI, but that's under very active development at this point.
For now, running something like docker-compose --scale worker=2
or just plain docker-compose up
is the way to go.
To run a custom image, you can change to the directory of your project and just run something like docker build -t mycompany/airflow:latest .
. If you've previously worked with the project in this directory it should have a Dockerfile
with FROM astronomerinc/ap-airflow:latest-onbuild
. If that file does not exist, you can simply create it.
Now that you have a base image, you can change the values inside the .env
file next to the docker-compose.yaml
file. You should be able to change IMAGE_NAME
, to whatever you named it before (mycompany/airflow), and set AIRFLOW_HOME
to path to your actual project. This will mount several directories from the image to the host so you can hack on your python code without restarting the docker-compose project. You will have to restart if you add anything to packages.txt
or requirements.txt
though.
This was basically what the old start
script did under the hood.
Hope that helps for now. @tedmiston and @andscoop can you guys help out with these docs and/or brainstorming any other ideas here?
from astronomer.
^ One typo in the third command above — should be docker build ...
I'll update the docs in Open to reflect what Greg wrote.
from astronomer.
@tedmiston closing this out today? If not, remove from milestone
from astronomer.
@ryw Yes, I'll close it today
from astronomer.
@tedmiston ... only one other issue left, it's you vs. brad :)
from astronomer.
Mostly working on Kafka today so he'll probably win that one. This one is end of day for me.
from astronomer.
Closed via #39
from astronomer.
Related Issues (20)
- auth sidecar enhancements HOT 2
- Issue with apiVersion helpers and AWS EKS HOT 1
- [This was actually changed to 5Gi](https://github.com/astronomer/astronomer/commit/061c85e040d50a849e3ed307e19eed15d53699eb), which means these are out of sync and the alert will not fire at 90% using these defaults. We should update charts/prometheus/templates/prometheus-alerts-configmap.yaml with a comment pointing to this default, and also figure out how we want to reconcile this difference. IMHO we can just bump this to 5Gi.
- Help needed - additionalVolume not parsable by helm with version 0.25.8 HOT 3
- Kibana content-security-policy page errors HOT 4
- Fluentd flush_at_shutdown?
- [HELM] Hardcoded Ingress hostnames for main Astronomer components HOT 2
- [HELM] Not possible to set custom Ingress annotations without enabling authSidecar HOT 3
- [HELM] Not possible to use Deployment for FluentD HOT 4
- Add ability to provide individual subdomain tls cert HOT 1
- K8s v1.22 support HOT 2
- Add k8s 1.22 support for astronomer airflow-chart HOT 1
- cannot use 'airflow db shell' command in scheduler container in astro cli HOT 5
- Provide correct email templates for developers if runtime upgrade fails. HOT 1
- Expose prometheus scrape intervals HOT 1
- email recipients within the UI not receiving deployment unhealthy email alerts HOT 1
- postgres grant statement fails with user@host:pw@host syntax HOT 16
- False alert for alertname: TargetDown HOT 4
- Feature Request: Filterable Deployments on Lineage Issues Page HOT 2
- performanceOptimizationModeEnabled - Needs some elaboration in document HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from astronomer.