-
### What happened
I am running table compaction using Spark Actions. my spark action code is:
```scala
sparkActions
.rewriteDataFiles(table)
.option(RewriteDataFiles.PARTI…
-
create an intake catalog to describe the various stages of data.
-
Write a DAG/Task that invokes the DS Docker container to stage-in data from the DS catalog.
Eventually this Task needs to be executed as part of the new Application Package CWL DAG, and followed by th…
-
Hello,
I was confused that the following snippet returned a "normal" `xarray` object instead of one backed by dask arrays:
```py
cat = intake.open_catalog("https://data.nextgems-h2020.eu/catalo…
-
Do we have tools to monitor the health of the data services in the IOOS catalog?
@ocefpaf just discovered this morning that his demo wasn't working because
http://crow.marine.usf.edu:8080/thredds/…
-
As a Data Engineer I would like to use the Unity Catalog on the Parking solution sample so I understand how it works and I don't need to work with the legacy Hive Metastore
**DoD**
- Successfully dep…
-
### Is there an existing issue for this?
- [X] I have searched the existing issues
### Feature description
Extend LocalStack's existing Redshift emulation to include Spectrum-like capabilities, all…
-
## Enhancement
We're using Iceberg/S3 as a backing store, and looking at Starrocks for compute (**i.e. ingestion into iceberg outside of SR, but using a SR external iceberg catalog for read-only comp…
-
source: [community Slack thread](https://getdbt.slack.com/archives/C01F91XJ5PY/p1727053178396149)
If the data platform provides rowcounts as a column in the resultset of `information_schema.tables`…
-
Collaborators at CUAHSI will work on this to extend the record registration to the data catalog.
#JIRA=CAM-54