Open mustafaali96 opened 1 year ago
Hi @mustafaali96, thank you for opening an issue! I'll tag some folks who should be able to help and we'll get back to you as soon as possible. cc @azureml-github
Thanks for the feedback! We are routing this to the appropriate team for follow-up. cc @azureml-github @Azure/azure-ml-sdk @klaaslanghout.
are there any provided updates to this issue? facing a the same problem here.
are there any provided updates to this issue? facing a the same problem here.
No @humak you can use pip install deltalake which is way faster for large datasets
I was trying to read a delta table from Azure ML. I have already created data assets to register the delta table, which is located at an ADLS Gen 2 location. However, when attempting to load the data, I have noticed that large data sizes are taking an exceedingly long time and still unable to load data, the cell keeps running for hours.
I have confirmed that for small data sizes, the data is returned within a few seconds, which leads me to believe there may be an issue with the scalability of the data-loading process.