Big files in datawizard lead to NotReadableError - Githubissues

OpenEnergyPlatform / oeplatform

Repository for the code of the Open Energy Platform (OEP) website. The OEP provides an interface to the Open Energy Family

http://openenergyplatform.org/

GNU Affero General Public License v3.0

62 stars 19 forks source link

Big files in datawizard lead to NotReadableError #1893

Open ebroda opened 1 month ago

ebroda commented 1 month ago

Description of the issue

If you open https://openenergyplatform.org/dataedit/wizard/.
And upload a BIG CSV file (> 1 GB) (e.g. File) The platform returns a NotReadableError: File could not be read

Expected behaviour would be that the platform can handle the dataset.

Steps to Reproduce

see above

Ideas of solution

Probably there are some issue in regard to the file size on reading the csv file. Maybe we need to find a way to have smaller chunks.

Context and Environment

Version used: current
Operating system: linux
Environment setup and (python) version:

Workflow checklist

[x] I am aware of the workflow in CONTRIBUTING.md