-
delta-rs was included as an optional dependency in [aws-sdk-pandas](https://github.com/aws/aws-sdk-pandas), but that means it's still not included in the pre-built layer, so it's still hard to use del…
-
### Checks
- [X] I have checked that this issue has not already been reported.
- [X] I have confirmed this bug exists on the [latest version](https://pypi.org/project/polars/) of Polars.
### Re…
-
- **Package Name**: mltable
- **Package Version**: 1.1.0
- **Environment**: Azure ML Notebook
- **Python Version**: 3.9
I was trying to read a delta table from Azure ML. I have already created …
-
For users saving the delta table in metastore, it is more convenient to use `table_name` to reference the data than the path argument of `create_pytorch_dataloader`
```
create_pytorch_dataloader(
…
-
Users need to configure their SparkSession for localhost development so computations run fast and so that they don't run out of memory.
Here are some examples I ran on my local machine that has 64G…
-
# Description
It will be great of there was support to read delta tables registered in Hive catalog. Apache spark also supports this.
Currently, AFAIK, only AWS glue catalog is supported.
**Use C…
-
### Checks
- [X] I have checked that this issue has not already been reported.
- [X] I have confirmed this bug exists on the [latest version](https://pypi.org/project/polars/) of Polars.
### Reprodu…
-
### Checks
- [X] I have checked that this issue has not already been reported.
- [X] I have confirmed this bug exists on the [latest version](https://pypi.org/project/polars/) of Polars.
### Reprodu…
-
Hi,
I are using this "s3-sqs" connector with spark structured streaming and deltalake to process incoming data in partitioned s3 buckets.
The problem I are facing is with "s3-sqs" source is that the…
-
# Environment
**Delta-rs version**: 0.15.1
**Binding**: Python
**Environment**:
- **Cloud provider**: AWS
- **OS**: MacOS
- **Other**: Github Action
***
# Bug
**What happened**:
Ca…