search

fohrloop / dash-uploader

The alternative upload component for python Dash applications.
MIT License
141 stars 29 forks source link

upload and view csv file contents without reopening with pandas #46

Closed hrampadarath closed 2 years ago

hrampadarath commented 3 years ago

Hi,

I'm working on an app where the user will upload a csv file to the server, do some preprocessing and then fit some ML models. What I understand, dash_uploader uploads the file to the server folder and then I have to use pandas to load the csv file into the app. For large files, this doubles the time needed to actually have the file loaded into the app.

All examples I am seeing of dash_uploader just prints the filename to the app. Is there a way to view the contents of the file, without reopening, with pandas etc?

fohrloop commented 3 years ago

Hi,

If I understood right most of the time used goes into these two processes

1) Uploading csv file to the server 2) Using a callback to fill some HTML component with contents of a dataframe. There will be some time needed for downloading the data from the server to the user.

Am I correct? If so, I guess the only thing you might be able to do to reduce the time needed is to reduce the amount of data that you want to show in the browser. Does the whole dataframe content need to be shown at once? Or just some rows or columns, or perhaps some statistics calculated from it?

fohrloop commented 2 years ago

Closing this due to inactivity. Please feel free to reopen if needed.