-
Write a DAG/Task that invokes the DS Docker container to stage-in data from the DS catalog.
Eventually this Task needs to be executed as part of the new Application Package CWL DAG, and followed by th…
-
Collaborators at CUAHSI will work on this to extend the record registration to the data catalog.
#JIRA=CAM-54
-
As a Data Engineer I would like to use the Unity Catalog on the Parking solution sample so I understand how it works and I don't need to work with the legacy Hive Metastore
**DoD**
- Successfully dep…
-
### Describe the problem
As discussed, we want to shift away from the catalogs repo being our source of truth so we can include more of the dynamic info that comes from our data pipeline.
### Propo…
-
source: [community Slack thread](https://getdbt.slack.com/archives/C01F91XJ5PY/p1727053178396149)
If the data platform provides rowcounts as a column in the resultset of `information_schema.tables`…
-
Meta tracking task to see if we can:
1. Move a set of archival files off of NCAR or another cluster into LEAP's OSN bucket.
2. Create a virtualizarr reference from the files on OSN.
3. Add the vi…
-
### Is there an existing issue for this?
- [X] I have searched the existing issues
### Feature description
Extend LocalStack's existing Redshift emulation to include Spectrum-like capabilities, all…
-
## Enhancement
We're using Iceberg/S3 as a backing store, and looking at Starrocks for compute (**i.e. ingestion into iceberg outside of SR, but using a SR external iceberg catalog for read-only comp…
-
Add links to CHORDS catalog entries for specific data resources, data sets, and tools demonstrated in toolkit tutorials.
- [x] Test example link to a specific catalog entry
- [ ] Crosslink each tuto…
-
### Description
User Impersonation enables the REST catalog to perform actions on behalf of a specified user. This feature allows clients to impersonate users when interacting with the Iceberg catalo…