-
We should introduce TypeCoercionTestSetup record which is used in BaseIcebergConnectorTest.
Also, nested types (e.g. array(array(...))) should be tested after the refactoring.
ebyhr updated
3 weeks ago
-
Is there any plans to add support for Delta lake tables?
-
- [x] https://github.com/trinodb/trino/pull/10897
- [x] https://github.com/trinodb/trino/issues/11297
- [x] https://github.com/trinodb/trino/issues/11299
- [x] https://github.com/trinodb/trino/issu…
-
Following up on https://github.com/iterative/dvc/issues/10313 and related new features specifying `datasets` as dependencies, we can add more types of supported datasets:
- [delta lake](https://itera…
-
Support transactions that e.g. insert data concurrently, or such that modify data within disjoint data sets (eg partitions).
-
### Motivation
Delta Lake is a very performant and robust storage system with [ACID](https://delta-io.github.io/delta-rs/how-delta-lake-works/delta-lake-acid-transactions/) (Atomic, Consistent, Isola…
-
Python Polars has support for delta lake files already though I can't find the function exposed in the rust package.
-
### What is the problem the feature request solves?
Comet currently only support either Spark's built-in data sources, or Iceberg ([WIP](https://github.com/apache/iceberg/pull/9841)). We should also …
-
## Bug
#### Which Delta project/connector is this regarding?
- [x] Spark
- [ ] Standalone
- [ ] Flink
- [ ] Kernel
- [ ] Other (fill in here)
### Describe the problem
[Writer Require…
-
polars seems to support it but it's implemented on the python side: https://pola-rs.github.io/polars/py-polars/html/reference/api/polars.read_delta.html
the underlying delta lake interface lib is w…