-
We are trying to complete the Alluxio caching support roll out now that Trino 438 is out. Following is the proposed sequence of tasks with status and mention of contributors and others helping.
Ini…
-
Hi all,
I'm using Spark version 3.2.0 along with Delta Lake version 1.2.1. I've established connectivity between Spark and the Hive metastore. Additionally, I've connected Presto to Hive using a co…
-
# Environment
**Delta-rs version**: 0.18.2
**Binding**: Python
**Environment**:
- **Cloud provider**: AWS
- **OS**: MacOS Sonoma 14.5
- **Other**: Running locally with admin permissions
…
-
#16248 is going to support adding a new field for Iceberg in Trino. Databricks and OSS Delta support adding a field to Delta tables. It would be nice to support in Delta Lake connector as well.
ebyhr updated
7 months ago
-
As mentioned by @djouallah in [this PR](https://github.com/delta-io/delta-rs/pull/1993), there are some queries where Parquet outperforms Delta Lake for DataFusion.
I mentioned in the thread how da…
-
Consider this code merging data with a generated column:
```python
# Databricks notebook source
tableName = "TARGET_SCHEMA.generatedTableTest"
# COMMAND ----------
spark.sql(f"DROP TABLE IF…
-
## Feature request
#### Which Delta project/connector is this regarding?
- [x] Spark
- [ ] Standalone
- [ ] Flink
- [ ] Kernel
- [ ] Other (fill in here)
### Overview
UniForm now s…
-
https://github.com/delta-io/delta/blob/master/PROTOCOL.md#v2-checkpoint-table-feature
- [x] Read https://github.com/trinodb/trino/pull/19507
- [ ] Write
ebyhr updated
7 months ago
-
Is there plans to integrate delta.io with Apache Beam?
For example - ParquetIO is supported: https://beam.apache.org/documentation/io/built-in/
Delta being **open-source** storage layer having Apa…
-
### Description
when 2 jobs run OPTIMIZE command on same delta table, one of them throws Py4JJavaError exception. I was expecting ConcurrentDeleteDeleteException exception.
#### Steps to reproduce…