-
**Context**
Currently only linear pipelines are compatible with `odtp`. In order to allow the evaluation and execution of DAG we need a solution for this in `workflow.py`.
**Solution**
**Barfi** is …
-
Will the kis-flow support DAG scheduling later?
```yaml
pipeline:
- depend_on: flow1
```
like the above config
-
There are two notable performance issues with materializing "be/catalog_as_dataframe":
For info: The `be/catalog_as_dataframe` asset takes ~1 min to materialise. It converts the catalogue metadata …
-
### Apache Airflow version
Other Airflow 2 version (please specify below)
### If "Other Airflow 2 version" selected, which one?
2.8.3
### What happened?
We use a structure of git submod…
-
[This](https://github.com/Snowflake-Labs/sfguide-data-engineering-with-snowpark-python-intro/blob/main/steps/07_deploy_task_dag.py) appears to be backwards:
![image](https://github.com/Snowflake-La…
-
python3 web_service.py -c config.yml
args config: {'rpc_port': 18091, 'http_port': 9998, 'worker_num': 10, 'build_dag_each_worker': False, 'dag': {'is_thread_op': False, 'retry': 10, 'use_profile': …
-
## What
The existing Workflows API includes ingestion logic in the API itself. To be able to generalize the Workflows API for different ingestion processes and stakeholders (i.e. MAAP and VEDA) the…
-
Change length of clintInfo Column in trino_event db trino_queries table from archer(255) to varcher(16777215)
Airflow populate this field and put the information below if dag name is longer and mor…
-
### Description
The scenario dag tasks could have outline colors to indicate in which state they are in when the scenario is submitted:
- yellow means "pending"
- orange means "running"
- green me…
-
### Apache Airflow version
Other Airflow 2 version (please specify below)
### If "Other Airflow 2 version" selected, which one?
2.8.2
### What happened?
Failure callback on SSHOperator is not bei…