-
Write a DAG/Task that invokes the DS Docker container to stage-in data from the DS catalog.
Eventually this Task needs to be executed as part of the new Application Package CWL DAG, and followed by th…
-
### Is there an existing issue for this?
- [X] I have searched the existing issues
### Feature description
Extend LocalStack's existing Redshift emulation to include Spectrum-like capabilities, all…
-
## Enhancement
We're using Iceberg/S3 as a backing store, and looking at Starrocks for compute (**i.e. ingestion into iceberg outside of SR, but using a SR external iceberg catalog for read-only comp…
-
### Terms
- [X] Before you openning this issue, i have checked if the issue has already been reported.
### Bagisto Version(s) affected
Master
### Issue Description
Adding dropdown details in a se…
-
source: [community Slack thread](https://getdbt.slack.com/archives/C01F91XJ5PY/p1727053178396149)
If the data platform provides rowcounts as a column in the resultset of `information_schema.tables`…
-
Meta tracking task to see if we can:
1. Move a set of archival files off of NCAR or another cluster into LEAP's OSN bucket.
2. Create a virtualizarr reference from the files on OSN.
3. Add the vi…
-
### What happened
Every so many seconds we append new data to a Table using pyIceberg (using Arrow tables).
On the background we run some Table maintenance operations; specifically removing old da…
-
Collaborators at CUAHSI will work on this to extend the record registration to the data catalog.
#JIRA=CAM-54
-
Currently, we create a top level domain and attach data sources to it and a scan object is assigned to the data source. This results in the scan objects being added to a domain.
By going through the …
-
Hello,
I was confused that the following snippet returned a "normal" `xarray` object instead of one backed by dask arrays:
```py
cat = intake.open_catalog("https://data.nextgems-h2020.eu/catalo…