-
### Describe the problem
As discussed, we want to shift away from the catalogs repo being our source of truth so we can include more of the dynamic info that comes from our data pipeline.
### Propo…
-
### What happened
I am running table compaction using Spark Actions. my spark action code is:
```scala
sparkActions
.rewriteDataFiles(table)
.option(RewriteDataFiles.PARTI…
-
create an intake catalog to describe the various stages of data.
-
1) Use scalar_one() over scalar() since the expected is to return one user/list
2) Extra } on @router.delete("/users/{user_id}/lists/{list_id}}")
3) On def get_stores(): the try has the db transact…
-
Do we have tools to monitor the health of the data services in the IOOS catalog?
@ocefpaf just discovered this morning that his demo wasn't working because
http://crow.marine.usf.edu:8080/thredds/…
-
Write a DAG/Task that invokes the DS Docker container to stage-in data from the DS catalog.
Eventually this Task needs to be executed as part of the new Application Package CWL DAG, and followed by th…
-
Hello,
I was confused that the following snippet returned a "normal" `xarray` object instead of one backed by dask arrays:
```py
cat = intake.open_catalog("https://data.nextgems-h2020.eu/catalo…
-
As a Data Engineer I would like to use the Unity Catalog on the Parking solution sample so I understand how it works and I don't need to work with the legacy Hive Metastore
**DoD**
- Successfully dep…
-
Collaborators at CUAHSI will work on this to extend the record registration to the data catalog.
#JIRA=CAM-54
-
### Is there an existing issue for this?
- [X] I have searched the existing issues
### Feature description
Extend LocalStack's existing Redshift emulation to include Spectrum-like capabilities, all…