-
### What happened
Every so many seconds we append new data to a Table using pyIceberg (using Arrow tables).
On the background we run some Table maintenance operations; specifically removing old da…
-
source: [community Slack thread](https://getdbt.slack.com/archives/C01F91XJ5PY/p1727053178396149)
If the data platform provides rowcounts as a column in the resultset of `information_schema.tables`…
-
Meta tracking task to see if we can:
1. Move a set of archival files off of NCAR or another cluster into LEAP's OSN bucket.
2. Create a virtualizarr reference from the files on OSN.
3. Add the vi…
-
Currently, we create a top level domain and attach data sources to it and a scan object is assigned to the data source. This results in the scan objects being added to a domain.
By going through the …
-
### 📜 Description
Currently, Backstage allows self-referencing in the catalog-info.yaml file (e.g., a group referencing itself as a child). This creates a logical inconsistency and leads to performan…
-
Hello,
I was confused that the following snippet returned a "normal" `xarray` object instead of one backed by dask arrays:
```py
cat = intake.open_catalog("https://data.nextgems-h2020.eu/catalo…
-
### Preconditions and environment
- Magento version 2.4.x
### Steps to reproduce
1. **Create a New Product**:
- Navigate to **Catalog** > **Products**.
- Click on **Add Product**.
- F…
-
### Description
User Impersonation enables the REST catalog to perform actions on behalf of a specified user. This feature allows clients to impersonate users when interacting with the Iceberg catalo…
-
![CleanShot 2024-12-04 at 09 23 25@2x](https://github.com/user-attachments/assets/3eeadb67-3bfa-4e05-8f72-a34389cacf7c)
`[INFO] 2024-12-04T17:21:48.288Z 8c0f8ee5-3f20-47eb-ab0a-6f690d0bfb06 azul.se…
-
**Scenario:** A data provider operates multiple EDC connectors and data catalogs
**Problem:** If a data consumer is unaware of which EDC holds the desired offer, he needs to iterate over all catalogs…