-
https://airflow.apache.org/
https://github.com/apache/airflow/tree/main/airflow/providers
-
Similar to https://github.com/sul-dlss/dlme-airflow/issues/531, we have some collections (LoC) which use the `custom_json` driver and we need to harvest a list of items instead of a collection.
-
### Description
Currently, InLong supports both real-time and offline data synchronization.
The offline data sync is scheduled repeatedly by the schedule engine.
#10412 introduced a built-in sche…
-
Airflow에서 데이터 가공할 때 사용할 Spark Cluster를 구성해야 합니다.
csv 파일 다 합치니까 row수가 20만 정도 되고 앞으로 데이터 더 받을 것을 고려한다면 spark cluster가 필요할 것 같습니다
- [x] Spark Cluster 구축하기
- [x] Airflow SparkOperator로 Spark Cluster에…
-
If the bug is related to a specific library below, please raise an issue in the
respective repo directly: TFX
**System information**
- Have I specified the code to reproduce the issue (Yes, No)…
-
### Describe the feature request.
See Slack thread here for details: https://mojdt.slack.com/archives/C06TFT94JTC/p1728513340561769
### Describe the context.
Have added functionality to airflow t…
-
### Description
As per users' feedback in the Airflow Debugging Survey 2024, 55.2% respondents find stack traces challenging.
### Use case/motivation
Goal for this issue:
- Configure depth of stack…
-
### Discussed in https://github.com/kedro-org/kedro/discussions/1716
Originally posted by **kangshung** July 20, 2022
Hey, are there any plans to add KedroOperator to [an official Airflow prov…
-
**Problema**
Os parâmetros de callback do Airflow _on_retry_callback_ e _on_failure_callback_ estão setados como _None_ na geração de DAGs, não permitindo a notificação por email/slack/etc. quando a …
-
apache/airflow:2.10.0
apache/airflow:airflow-pgbouncer-2024.01.19-1.21.0
apache/airflow:airflow-pgbouncer-exporter-2024.06.18-0.17.0