-
Hello,
We would like your assistance in order to better understand how to tweak our current setup to achieve better performance. Please find our case scenario below:
We are in the process of buil…
-
I'm trying to read raster file using mosaic library to fetch H3 cell indices and measures values and write them in delta lake. But its throwing java.lang.NegativeArraySizeException when I tried to wri…
-
Hi all,
My colleagues and I are a bit confounded by our SA results, and we hope that this great community could help provide some clarifications.
During a multi-model comparison project for four…
-
I'm trying to create an environment of PySpark, Delta Lake and Jupyter Notebook with Docker.
Everything seems to be using the same Spark, Scala and Java version. (3.5, 2.12.18, 17.0.8.1)
I'm una…
-
**Describe the bug**
As I append more and more to a hyper, the write time to do so goes up and up. I have a large folder with parquet files with roughly the same amount of data /size. I iterated thro…
-
# Module: 00
## Lab/Demo: Use Delta Lake in Azure Databricks
### Task: Create catalog tables
#### Step: 1
Description of issue : Not able to create the table
Repro steps:
1. Run Step 1 (d…
-
Describe the feature
I would like dbt-databricks to support Liquid Clustering natively as part of the dbt configuration. Currently, clustering can be achieved via manual configurations, such as parti…
-
When installing the `multpl` openbb extension and building the Python interface as recommended by the [docs](https://docs.openbb.co/platform/installation#post-installation), I encounter an error when …
-
## Issue Description
While testing Seafowl with local storage using the Azure Blob CSI driver in Kubernetes (due to the lack of native Azure Blob support in Seafowl), we encountered the following e…
-
## Description
Currently the `delta-base` dataset requires `delta-spark~=1.2.1` which [requires spark 3.2](https://github.com/delta-io/delta/releases/tag/v1.2.1). This means that any databricks use…