Comments (3)
Sry that I labeled my question as a bug - I didn't know how else to get in contact with you.
from airflow-code-editor.
I experienced the same issue and figured out what the problem is.
This code editor stores DAG files in airflow-webserver. Airflow helm charts for airflowVersion > 2.0
, it deploys airflow-scheduler as a separate pod along side the airflow-webserver, and DAGs files should be stored inside the airflow-scheduler pod. https://github.com/apache/airflow/blob/cae96630e1ddc1d3aae867c41d137e1d1fd7d465/chart/templates/webserver/webserver-deployment.yaml#L271-L283
As long as webserver and schedulerr pods are not using a shared volume for DAGs files, this code editor will not work.
As a workaround, we can create a RWX volume and mount it on both webserver and scheduler pods, at dags file path.
from airflow-code-editor.
Here is my custom values with verion 1.13.1 chart.
dags:
persistence:
enabled: true
size: 1Gi
storageClassName: azurefile-csi
accessMode: ReadWriteMany
webserver:
extraVolumes:
- name: dags
persistentVolumeClaim:
claimName: airflow-staging-dags
extraVolumeMounts:
- name: dags
mountPath: /opt/airflow/dags
You'll need to change the claimName based on your helm release name. My helm release name is airflow-staging.
from airflow-code-editor.
Related Issues (20)
- Dag loads slowly
- WEbUI DAG It need took a long time to find HOT 1
- How do I install extra packages from the code editor HOT 1
- How does aws airflow simply introduce this plugin? HOT 1
- REST end points? HOT 2
- Dag file editor can browse files, but cannot open it - file not found HOT 6
- Dag file editor with airflow in cluster mode, can i configure to write to worker pod? HOT 2
- working with aws MWAA HOT 3
- Cannot rename/remove file if git is not installed HOT 4
- working on gcp HOT 1
- 'file not found' error for JSON files HOT 4
- Cannot read properties of undefined (reading 'href') HOT 2
- DAG Serialization HOT 4
- user level code editing permission HOT 2
- Pull dags from git repository HOT 1
- Plug-in broken after v2.7.0 update: No module ‘psslib’ HOT 3
- airflow-code-editor on Airflow Composer(GCP) doesn't detect composer folders - dag, data, log, etc. HOT 2
- 308 (blocked:mixed-content) HOT 1
- File with spaces not supported in Git
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from airflow-code-editor.