Background:

I deployed airflow and airflow-code-editor behind a proxy that handles the SSL termination.

Description

When I go to code_editor home or click a folder under left navigator, the page tries to fetch data by calling
https://mydomain.com/code_editor//tree/files?long=true, but a 308 redirect returned with a location
http://mydomain.com/code_editor/tree/files?long=true. The scheme changed from https to http, which resulted in a complaining from broswer with exception Mixed Content: The page at '<URL>' was loaded over HTTPS, but requested an insecure XMLHttpRequest endpoint '<URL>'. This request has been blocked; the content must be served over HTTPS. and page could not load appropriately.

I have set up airflow ver2.0.2 with airflow-code-editor but stuck in the issue:

also, the log said this while I am trying to install the module:

Please help.
I am not using docker for this

I just installed the plugin (v2.4.0) on v2.0.0b2 and I see

Broken plugin: [airflow_code_editor.airflow_code_editor] No module named 'flask_admin' 

Is there already compatibility with v2.0?

Hi.

Thank you for this package, it is really saved my day!

How about adding "New file" button?
Currently there is only one option to make new file - open the existing one and then use "Save as" button with entering new file location.
But sometimes there are no files in the dags folder. In case of completely new installation the only way to create first file is to to that using some external tool, like file manager or console.

IMHO this will be really useful feature.

Getting this error. The importlib-metadata was yestarday updated to 2.0.0

Broken plugin: [airflow_code_editor.airflow_code_editor] (importlib-metadata 2.0.0 (/usr/local/lib/python3.7/site-packages), Requirement.parse('importlib-metadata<2,>=0.23; python_version == "3.7"'), {'argcomplete'})

After upgrading apache-airflow from 2.2.3 to 2.3.3, started getting error while trying to open files thru dag-code-editor 6.0.0.

I can navigate in all folders, see all files, but when trying to open any of them "file not found" issue shows up

Currrent folder config:

[core]
dags_folder = /data/airflow/dags

[code_editor]
 root_directory = /data/airflow

Hello,

I am experiencing a bug where I cannot open an existing .json file. This bug happens if I use the UI to create the json file from scratch and if I upload a file created using the JSON module from my local machine. The file will continue to show up in the folder browser and I can manipulate it (move/rename). When clicking the json file, it opens a blank file editor with the message in the top left 'file not found'.

I have confirmed with my server admin that the file exists on the server with the contents I used when creating it. The file is also readable by a DAG. Strangely, I have been able to open the file once or twice successfully and view/edit the contents, but after a short period it will become un-openable.

Any help would be greatly appreciated

when multiple airflow webserver run behind nginx with base_url， editorSave post to "/code_editor/files"， which expect to be prefix with webserver base_url

airflow code editor version 3.3.0
airflow version 2.0.1
python version 3.8
OS: RHEL 8
seems like a permission issue, could you give me a hint? if any i can resolve by my self. thanks.

but Git GUI is able to read *.dag.

Hi, I'm using the airflow of docker deployment. Currently, if I'm saving the script file/A /b/c/d.sh in the code_editor multilevel directory, it will take about two minutes for the daG screen to show this task. If I'm directly saving the script in the root directory of daG (for example, as /d.sh), IT will take about two minutes for the daG screen to show this task. This will show up on the DAG page very quickly, what are the optimizations for this load delay

Hi!

Is there any way to pull dags from a remote repository through the git user interface?

Thank you in advance!

Hi,

I would like to solve
https://stackoverflow.com/questions/72726969/how-can-we-use-airflow-code-editor-or-simple-dag-editor-on-aws-airflow-mwaa/73454971#73454971

I follow every Andrea instruction but it doesn't work.
I will post more info here to help

Our configuration :

MWAA airflow version is 2.2.2

To setup airflow-code-editor :
I added the code_editor.mount envariable in MWAA (name=dags,path=s3://our_bucket)
I added this to my requirements

# plugins
black  # for airflow-code-editor
fs-s3fs # for airflow-code-editor
airflow-code-editor>=7.0.0

MWAA has been tested with s3:* on * permissions

What works:

airflow-code-editor is accessible
in the "files" folder we fine our dags
in the "dags" folder we fine our dags
reading dags

What doesn't work:

upload does nothing
+new open an editor, the button save make the following error
Error saving dag/new file.txt: operation failed, [Errno 30] Read-only file system: b'/usr/local/airflow/dags/'
opening a dags and clicking save
Error saving tutorial_dag_from_airflow.py: operation failed, [Errno 30] Read-only file system: b'/usr/local/airflow/dags/tutorial_dag_from_airflow.py'

What I can do to help

I would take me a bit of time to anonymize but I could provide the terraform code to reproduce
I also can write PR with a bit of guidance for where to search the bug

Thanks
Regards
Hugo

Hello, we are using aws airflow, but its dag file is stored in s3, we want to be able to directly manipulate the s3 file, do not know what adjustments need to be done?
Please help me, thanks.

It would be really nice if we could use environment variables instead of updating the airflow.cfg like standard Airflow configurations. E.g.:

• AIRFLOW__CODE_EDITOR__GIT_ENABLED
• AIRFLOW__CODE_EDITOR__MOUNT_NAME
• AIRFLOW__CODE_EDITOR__MOUNT_PATH
• ...

Currently, files are saved in the /dag directory by default. It is expected that customized directories can be saved and the corresponding directories can be viewed on the webui

I am trying to change root_directory to some other folder which is not the default dag folder set in airflow.cfg

But it is not reflecting in the dag code editor

when i store as a python file, like xx.py in dag_editor, but about 1mintus i can see it in dags page. the time is so long , i want to ask how to change it

Is it possible hidden the password or other credential from Connection Object ?

I am getting this error when I install the airflow_code_editor (v 2.4.) with airflow (1.10.11) - any ideas how to resolve?
Thanks in advance.

$ airflow version
[2020-10-30 12:59:54,616] {plugins_manager.py:112} ERROR - Failed to import plugin airflow_code_editor
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/airflow/plugins_manager.py", line 106, in load_entrypoint_plugins
    plugin_obj = entry_point.load()
  File "/usr/lib/python3/dist-packages/pkg_resources/__init__.py", line 2323, in load
    self.require(*args, **kwargs)
  File "/usr/lib/python3/dist-packages/pkg_resources/__init__.py", line 2346, in require
    items = working_set.resolve(reqs, env, installer, extras=self.extras)
  File "/usr/lib/python3/dist-packages/pkg_resources/__init__.py", line 783, in resolve
    raise VersionConflict(dist, req).with_context(dependent_req)
pkg_resources.ContextualVersionConflict: (attrs 19.3.0 (/usr/local/lib/python3.6/dist-packages), Requirement.parse('attrs>=20.1.0'), {'cattrs'})

Traceback (most recent call last):
  File "/usr/local/bin/airflow", line 26, in <module>
    from airflow.bin.cli import CLIFactory
  File "/usr/local/lib/python3.6/dist-packages/airflow/bin/cli.py", line 94, in <module>
    api_module = import_module(conf.get('cli', 'api_client'))  # type: Any
  File "/usr/lib/python3.6/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "/usr/local/lib/python3.6/dist-packages/airflow/api/client/local_client.py", line 24, in <module>
    from airflow.api.common.experimental import delete_dag
  File "/usr/local/lib/python3.6/dist-packages/airflow/api/common/experimental/delete_dag.py", line 26, in <module>
    from airflow.models.serialized_dag import SerializedDagModel
  File "/usr/local/lib/python3.6/dist-packages/airflow/models/serialized_dag.py", line 33, in <module>
    from airflow.serialization.serialized_objects import SerializedDAG
  File "/usr/local/lib/python3.6/dist-packages/airflow/serialization/serialized_objects.py", line 28, in <module>
    import cattr
  File "/usr/local/lib/python3.6/dist-packages/cattr/__init__.py", line 1, in <module>
    from .converters import Converter, GenConverter, UnstructureStrategy
  File "/usr/local/lib/python3.6/dist-packages/cattr/converters.py", line 16, in <module>
    from attr import fields, resolve_types
ImportError: cannot import name 'resolve_types'

I tried updating attrs to 20.2.0 but then got this error with airflow.

$ airflow version
[2020-10-30 12:48:56,337] {plugins_manager.py:112} ERROR - Failed to import plugin airflow_code_editor
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/airflow/plugins_manager.py", line 106, in load_entrypoint_plugins
    plugin_obj = entry_point.load()
  File "/usr/lib/python3/dist-packages/pkg_resources/__init__.py", line 2323, in load
    self.require(*args, **kwargs)
  File "/usr/lib/python3/dist-packages/pkg_resources/__init__.py", line 2346, in require
    items = working_set.resolve(reqs, env, installer, extras=self.extras)
  File "/usr/lib/python3/dist-packages/pkg_resources/__init__.py", line 783, in resolve
    raise VersionConflict(dist, req).with_context(dependent_req)
pkg_resources.ContextualVersionConflict: (attrs 20.2.0 (/usr/local/lib/python3.6/dist-packages), Requirement.parse('attrs~=19.3'), {'apache-airflow'})
Traceback (most recent call last):
  File "/usr/local/bin/airflow", line 26, in <module>
    from airflow.bin.cli import CLIFactory
  File "/usr/local/lib/python3.6/dist-packages/airflow/bin/cli.py", line 94, in <module>
    api_module = import_module(conf.get('cli', 'api_client'))  # type: Any
  File "/usr/lib/python3.6/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "/usr/local/lib/python3.6/dist-packages/airflow/api/client/local_client.py", line 24, in <module>
    from airflow.api.common.experimental import delete_dag
  File "/usr/local/lib/python3.6/dist-packages/airflow/api/common/experimental/delete_dag.py", line 26, in <module>
    from airflow.models.serialized_dag import SerializedDagModel
  File "/usr/local/lib/python3.6/dist-packages/airflow/models/serialized_dag.py", line 33, in <module>
    from airflow.serialization.serialized_objects import SerializedDAG
  File "/usr/local/lib/python3.6/dist-packages/airflow/serialization/serialized_objects.py", line 28, in <module>
    import cattr
  File "/usr/local/lib/python3.6/dist-packages/cattr/__init__.py", line 1, in <module>
    from .converters import Converter, GenConverter, UnstructureStrategy
  File "/usr/local/lib/python3.6/dist-packages/cattr/converters.py", line 18, in <module>
    from ._compat import (
  File "/usr/local/lib/python3.6/dist-packages/cattr/_compat.py", line 31, in <module>
    from typing import get_args, get_origin  # NOQA
ImportError: cannot import name 'get_args'

How can I disable the plugin? I want to disable it in higher environments.

Describe the bug
Plug-in is broken after migrating to airflow v2.7.0. , Python 3.11.4.

To Reproduce
Steps to reproduce the behavior: install the plug-in on 2.7.0

Error displayed the Airflow UI — “Broken plugin: [airflow_code_editor.airflow_code_editor] No module named ‘psslib’”

Screenshots
If applicable, add screenshots to help explain your problem.

Server (please complete the following information):

• Airflow Code Editor version: latest version
• Airflow version: 2.7.0
• Environment: docker
• OS: Centos 8

Client(please complete the following information):

• Browser: all browsers
• Version [e.g. 22]

Additional context
Add any other context about the problem here.

I installed this and I am able to create and edit new file but got permission denied while trying to rename or remove the file. May I know what is the solution for this? I'm using airflow inside docker. Thanks

The .buttons css width is not enough.

$ pip show airflow_code_editor
Name: airflow-code-editor
Version: 3.3.0

Hi Team,

Is there a way we could install some dependent packages of the Dags which are hosted on PyPi via code editor. Maybe running requirements.txt file programatically/ button?

Thanks

Hi,

First of all: thank you for this great idea and work!!! Unfortunately, I couldn't manage to use it when deployed to an AKS via the latest airflow helm chart, using airflow version 2.8.3: any dag-py file (that I create with this plugin) and store under /opt/airflow/dags doesn't either show up in the dag section - or it isn't added to DagBag when using airflow dags reserialize. The logs don't reveal much more information.

Is it possible that the plugin can't be used in the aks context?

Thanks for your help!!

Thanks for building this amazing plugin. Pretty useful for data engineers, avoids them to go through deployment process for minor code change.

Everything is fine. But if lacks few basic functionalities like file upload.

Hello.

I've installed airflow-code-editor 3.3.1 on Airflow 1.10.14. Extension works great, but I don't see any icon:

According to template:

But Airflow v1 is using glyphicons:
https://github.com/apache/airflow/blob/4aec433e48dcc66c9c7b74947c499260ab6be9e9/airflow/www/static/bootstrap-theme.css#L2573-L2606

Airflow v2 is using Material icons:
https://github.com/apache/airflow/blob/fdea6226742d36eea2a7e0ef7e075f7746291561/airflow/www/static/css/material-icons.css#L20-L27

And also I don't see this font in static dir either:
https://github.com/andreax79/airflow-code-editor/blob/ffa14b4fbb10257bb9ec1efb77d0e376df166a96/airflow_code_editor/templates/index_head.html

How is that possible that there are no mentions of Font Awesome usage in both Airflow and aifrlow-code-editor, but icons are present in the README file? Could you please add it to the static files folder?

Is it possible to set ACL in the dag editor so that specific users can only edit particular dags?

Hi,

I'm running the Airflow webserver in a docker container and getting a permission denied popup window in the code editor UI upon opening that window:

Wondering if you can help me troubleshoot? I'm guessing it has something to do with the airflow user in the container not having permission to a folder used by the local git install, but not sure how to find out what exactly is being denied.

Here is my Dockerfile:

FROM puckel/docker-airflow:1.10.9

USER root

COPY airflow.cfg ./airflow.cfg
COPY /dags ./dags
COPY entrypoint.sh /entrypoint.sh
COPY requirements.txt /requirements.txt

# Add directory in which pip installs to PATH
ENV PATH="/usr/local/airflow/.local/bin:${PATH}"

# Install Git for airflow-code-editor:
RUN apt update
RUN apt install -y git

USER airflow

ENTRYPOINT ["/entrypoint.sh"]

# Just for documentation. Expose webserver, worker and flower respectively
EXPOSE 8080
EXPOSE 8793
EXPOSE 5555

The entrpoint.sh script is omitted for brevity, but just know that it calls pip install on requirements.txt, which contains only this dependency:

# requirements.txt
airflow-code-editor==2.1.1

If I attach the running container interactively, I can successfully call git with the airflow user, so again - wondering if there's a directory created somewhere specific for airflow-code-editor (when I was the root user) that the airflow user does not have access to?

Hi,

We wanna try your code editor, we had no troubles during installation. But when we tried to change theme. We've got this error:

TypeError: Cannot read properties of undefined (reading 'href')
at Proxy.setTheme (Editor.vue:178:116)
at Proxy.updateSettings (Editor.vue:188:18)
at tn (runtime-core.esm-bundler.js:155:22)
at pt (runtime-core.esm-bundler.js:164:21)
at Mc (runtime-core.esm-bundler.js:721:9)
at Proxy.ok (SettingsDialog.vue:68:18)
at b.onClick.t..t. (SettingsDialog.vue:21:27)
at tn (runtime-core.esm-bundler.js:155:22)
at pt (runtime-core.esm-bundler.js:164:21)
at HTMLButtonElement.n (runtime-dom.esm-bundler.js:369:13)

in console of web interface. Is there anything I miss ?

Thank

Hello, i ve installed the plugin via gpc console and after restarting the web server the module doesn't appear in admin menu.
anyone was able to make it working?
Thanks

Currently trying to install airflow-code-editor plugin. I'm using docker-compose-CeleryExecutor.yml from puckel for Airflow 2.0. I cloned the airflow-code-editor repository into my plugins folder and added it into my requirements.txt as well. I'm getting these errors on the webserver. How can I go about fixing this so I can use the plugin?

export AIRFLOW__CODE_EDITOR__MOUNT2_PATH='/tmp

it is should
export AIRFLOW__CODE_EDITOR__MOUNT2_PATH=/tmp

There is a way to configure airflow-code-editor to save files to dags folder in worker pod instead to dags forlde in webserver pod?

Thanks...

Hi, Is it possible to push dags to git repository using code editor? Currently I have installed code editor and donot see this option. However I can stage changes.

Appreciate any help on this topic?

Thanks,
Kamesh Rao

Since Airflow 2.0.0 DAG Serialization has been standard (and cannot be turned off). This seems to be a problem for airflow-code-editor, since the webserver no longer has access to the DAG files. Is there a way around this?

Describe the bug
I'm working with Airflow Composer (GCP), I installed the airflow-code-editor PyPI library, and when I entered to the code editor, he did not detect the composer DAGS(GCS) and any GCS folder, I also tried to set the "root_directory" and "mount"s Config Options, and I also install fs-gcsfs.

To Reproduce
Steps to reproduce the behavior:

1. Go to Airflow composer Version: 2.6.3+composer -> admin -> Dags Code Editor
2. Composer folders/buckets not detected.

Expected behavior
To see all the Composer folders( DAGS, data, logs, etc...)

Screenshots

Server (please complete the following information):

• Airflow Code Editor version: 7.5.0
• Airflow version: composer-2.5.1-airflow-2.6.3
• Environment: GCP composer

Client(please complete the following information):

• Browser chrome
• Version 123.0.6312.58 (Official Build) (arm64)

Is it possible for this package to expose the endpoints used in UI as REST? I have a custom UI based on react and want to integrate the APIs only from this package. Any help is highly appreciated.

Current API is only working with cookies not with basic auth.

I have installed the code editor and git via ubuntu wsl on windows.
I have added my airflow conf file as follows,
[code_editor]
git_cmd = /usr/bin/git
git_default_args = -c color.ui=true
git_init_repo = False
root_directory = /home/imthi/airflow/dags
line_length = 88
string_normalization = False
mount_name = data
mount_path = /home/imthi/airflow/data
mount1_name = logs
mount1_path = /home/imthi/airflow/logs

While i am trying to launch it through UI, it says no such a file or directory found