-
Currently, we don't let users enable `dags.gitSync ` and `dags.persistence` at the same time.
If we do this (obviously requiring `dags.persistence.accessMode = ReadWriteMany`), we can massively red…
-
https://github.com/VMois/miwaitway/blob/1e77fdedda58f139cf0097c5748a1c2d7c509a96/dags/load_realtime_to_bq.py#L99-L104
WRITE_TRUNCATE in the next PythonOperator task will do the job of cleaning up p…
-
I'm pulling Jira ticket data and dependencies and attempting to graph them. This is the result I have so far using all of Dagre's default sorting values.
There are many overlapping lines that I…
-
I realize mining RVN on 4GB cards isn't possible, but would it at least be possible to at least put in a check so that a 4GB card won't try and create/load the DAG? The reason I ask is that I have a r…
-
### Apache Airflow version
2.9.1
### If "Other Airflow 2 version" selected, which one?
_No response_
### What happened?
If a new dataset triggreed DAG is created for an already existing…
-
### Description
I'm proposing to add a new ExternalAPITaskSensor to the Apache Airflow project. This sensor leverages the Airflow REST API to monitor the status of an external DAG or task. It can be …
-
### Context
In some stacks, like mcp-test, when you try to use the `/list-workflows` endpoint, you get an `Internal Server Error`. The logs indicate that the function isn't returning a `dict`
`…
-
### dags
- 환경변수에 한투 API key 매일 갱신해주는 dag
- 예수금이 10일에 자동이체되면 portfolio의 accum_asset을 채우는 dag
1. 한투 API로 예수금 잔고 확인 (이체 확인)
2. 종목별 비율에 맞게 accum_asset 채우기
- db setting (asset update & portfo…
-
This issue is spun off from https://github.com/cityofaustin/atd-data-tech/issues/16582.
Presently, we use a `cron` job that utilizes `find` to delete log files and log file directories that are ol…
-
We currently only support non-linear DAGs, which limits the expressiveness of Fondant pipelines.
To support non-linear DAGs, we would need at least the following functionality:
- Compiling to non-lin…