andreax79 / airflow-code-editor

A plugin for Apache Airflow that allows you to edit DAGs in browser
Apache License 2.0
401 stars 50 forks source link

airflow-code-editor on Airflow Composer(GCP) doesn't detect composer folders - dag, data, log, etc. #76

Closed benzimegido closed 2 months ago

benzimegido commented 7 months ago

Describe the bug I'm working with Airflow Composer (GCP), I installed the airflow-code-editor PyPI library, and when I entered to the code editor, he did not detect the composer DAGS(GCS) and any GCS folder, I also tried to set the "root_directory" and "mount"s Config Options, and I also install fs-gcsfs.

To Reproduce Steps to reproduce the behavior:

  1. Go to Airflow composer Version: 2.6.3+composer -> admin -> Dags Code Editor
  2. Composer folders/buckets not detected.

Expected behavior To see all the Composer folders( DAGS, data, logs, etc...)

Screenshots image

Server (please complete the following information):

Client(please complete the following information):

andreax79 commented 7 months ago

It's likely that you have a problem with the configuration. Try the new version 7.6.0, which reports the underlying error message instead of the "no data for table" message. Please note that the root directory must be a local folder.

benzimegido commented 7 months ago

Thanks for your replay, I upgraded to the new version, and as you said, I got an informative error message:

image

It looks like it related to your last comment; "Please note that the root directory must be a local folder." What do you mean by that? I have configured the root folder as mentioned in the Composer GCS folder. Can you guide me on how to configure that?