-
Arrow has adopted the (IMO) much better binary and string view types. Supporting these would mean we could move data zero-copy to delta-rs. Currently it fails:
```python
df = pl.DataFrame({"a": ["…
-
https://github.com/trinodb/trino/actions/runs/6579766410/job/17876435012
```
Error: io.trino.plugin.deltalake.TestDeltaLakeAdlsConnectorSmokeTest.testVacuumWithTrailingSlash -- Time elapsed: 3.813 …
ebyhr updated
2 weeks ago
-
I am installing Apache SPARK for the first time. I was able to install the docker container.
I ran the following command:
docker pull apache/spark and then started the container using
docker …
-
It would be valuable to make it possible to dynamically create a partitioned catalog from the S3 file structure.
- Create a new `TableProvider` that uses S3 List and the folder structure to create …
-
### Checks
- [X] I have checked that this issue has not already been reported.
- [X] I have confirmed this bug exists on the [latest version](https://pypi.org/project/polars/) of Polars.
##…
-
Document the table features / protocol version that are supported by this project for each release.
If a Delta table has a table feature enabled that deltatorch does not support (like deletion vect…
-
```
Error: io.trino.plugin.deltalake.TestDeltaLakeDatabricksConnectorTest.testAddColumnConcurrently
Error: Run 1: TestDeltaLakeDatabricksConnectorTest>BaseConnectorTest.lambda$testAddColumnConcu…
-
For users saving the delta table in metastore, it is more convenient to use `table_name` to reference the data than the path argument of `create_pytorch_dataloader`
```
create_pytorch_dataloader(
…
-
# Description
It will be great of there was support to read delta tables registered in Hive catalog. Apache spark also supports this.
Currently, AFAIK, only AWS glue catalog is supported.
**Use C…
-
I am using DeltaMergeBuilder to perform upsert operation on my delta lake table. However, the source schema can change i.e new columns can be added to my source data frame. Therefore my delta lake tab…