Closed erickfigueiredo closed 1 month ago
You can increase the timeout by doing this: storage_options={"timeout": "100s"}
Thank you very much, @ion-elgreco ! It's working now!
Is there any documentation on all possible parameters that can be used in the storage_options
parameter? It would be very useful in my context!
@erickfigueiredo you can see most config keys here: https://docs.rs/object_store/latest/object_store/azure/enum.AzureConfigKey.html
Environment
Delta-rs version: 0.16.0
Environment:
Bug
What happened: I encountered the error
OSError: MicrosoftAzure Generic Error: Error in request or response body: Operation timed out
when attempting to load data containing millions of rows from a Delta Table (using Azure DataLake Gen 2). This error does not occur when I try to retrieve a smaller amount of data.What you expected to happen: I expected to load the data from the Delta table and convert it to a Pandas DataFrame without any errors.
How to reproduce it: