-
Write a Task that executes the DS Docker container to upload and catalog local data.
Eventually this Task needs to be part of the new Aopplication package DAG and be invoked after execution of the pro…
-
I am having some troubles trying to run the python example: **delta-sharing/examples/python/quickstart_spark.py** and I am getting this error:
```
Py4JJavaError: An error occurred while calling o6…
-
### What happened
I am running table compaction using Spark Actions. my spark action code is:
```scala
sparkActions
.rewriteDataFiles(table)
.option(RewriteDataFiles.PARTI…
-
### System Information
- **Spark or PySpark**: PySpark
- **SDK Version**: v1.2.8
- **Spark Version**: v2.3.2
- **Algorithm (e.g. KMeans)**: n/a
### Describe the problem
I'm following the instr…
-
-
Per New Relic, https://catalog.data.gov/dataset/ has a low Apdex score of .79 (> .90 is optimal) with an average page load of 6.3 seconds. Since the catalog dataset is the most viewed page, improved …
-
### Is there an existing issue for this?
- [X] I have searched the existing issues
### Feature description
Extend LocalStack's existing Redshift emulation to include Spectrum-like capabilities, all…
-
As a Data Engineer I would like to use the Unity Catalog on the Parking solution sample so I understand how it works and I don't need to work with the legacy Hive Metastore
**DoD**
- Successfully dep…
-
Write a DAG/Task that invokes the DS Docker container to stage-in data from the DS catalog.
Eventually this Task needs to be executed as part of the new Application Package CWL DAG, and followed by th…
-
Hello,
I was confused that the following snippet returned a "normal" `xarray` object instead of one backed by dask arrays:
```py
cat = intake.open_catalog("https://data.nextgems-h2020.eu/catalo…