Comments (3)
schnie
commented on May 30, 2024
Hey @Minyus, this is the approach we've taken since we need to also allow all of our customers to update os packages and python packages, in addition to the DAGs.
This chart does not have support for it yet, but there are some folks discussing it in the official apache project. It could absolutely be done and we'd need to support the traditional git fetch, or rsync style of DAG deployment.
How would you like to ideally be able to deploy your DAGs?
from airflow-chart.
Minyus
commented on May 30, 2024
Thanks for your reply, @schnie .
Noted.
The following options would be convenient.
- Upload a zip file including .py files in the Airflow web UI
- Upload a .py file in the Airflow web UI
- HTTP request to post the Python code to the server
rsync -rto a directory in the server
from airflow-chart.
danielhoherd
commented on May 30, 2024
We have handled this with git-sync, nfs, and are about to release a dag-only deploy feature. https://docs.astronomer.io/software/deploy-cli
from airflow-chart.
Related Issues (20)
- Spark binaries HOT 1
- Default ImagePullPolicy
- No gitSync config in values.yml HOT 1
- Astronomer maintenance of this repo? HOT 3
- Please update airflow version to 1.10.14 by default HOT 1
- If use 1.10.14-buster error alembic.script.revision.ResolutionError: No such revision or branch 'e959f08ac86c' HOT 1
- Can not change webserver.defaultUser.password when install by helm HOT 1
- Use helm-doc to generate parameter table
- Using Google Cloud Storage remote logging HOT 1
- Invalid image name when the image tag is integer HOT 6
- configmap sourced env values
- fernetKey when using airflow as dependency
- airflow command error: argument GROUP_OR_COMMAND: invalid choice: 'serve_logs' HOT 2
- Any helm upgrade with KEDA errors the scheduler HOT 1
- Syncing dags from multiple git-repos HOT 3
- Add imagePullSecret as a parameter to pull images from Private Container Registries HOT 1
- Help needed - additionalVolume not parsable by helm with version 0.25.8 HOT 1
- Unable to install chart "Deployment is not ready: airflow/airflow-scheduler" HOT 2
- Getting Airflow 404 = Lots of circles Error HOT 3
- Log Grooming script envvars HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from airflow-chart.