-
### What happened
Every so many seconds we append new data to a Table using pyIceberg (using Arrow tables).
On the background we run some Table maintenance operations; specifically removing old da…
-
### Describe the problem
As discussed, we want to shift away from the catalogs repo being our source of truth so we can include more of the dynamic info that comes from our data pipeline.
### Propo…
-
This is a step of making the automated test robust and informative. Detailed list of which ICD tests to be migrated is TBD (work-in-progress list [here](https://docs.google.com/spreadsheets/d/1qwdTTKd…
-
### HydroMT version checks
- [X] I have checked that this issue has not already been reported.
- [X] I have checked that this bug exists on the latest version of HydroMT.
### Reproducible Examp…
-
# Description
It will be great of there was support to read delta tables registered in Hive catalog. Apache spark also supports this.
Currently, AFAIK, only AWS glue catalog is supported.
**Use C…
-
Write a DAG/Task that invokes the DS Docker container to stage-in data from the DS catalog.
Eventually this Task needs to be executed as part of the new Application Package CWL DAG, and followed by th…
-
### Preconditions
1. Magento 2.1.7
2. PHP 7.0.22
### Steps to reproduce
1. Create a bundle product with at least 1 option of simple product
2. Create a module which defines any extension attri…
-
As a Commerce Merchant,
I would like Magento to reindex my entire catalog data into Storefront in less than 2 hours
So that
In the event, something is broken in the storefront data I can qui…
-
As a Commerce Merchant,
I would like Magento to quickly reindex my catalog data bulk updates into Storefront
So that
I can keep my Storefront application up to date with the latest product a…
-
Currently, we create a top level domain and attach data sources to it and a scan object is assigned to the data source. This results in the scan objects being added to a domain.
By going through the …