search

aodn / aodn-portal

AODN Open Geospatial Portal
https://portal.aodn.org.au/
GNU General Public License v3.0
21 stars 13 forks source link

CSV Can be greater than 1 million rows T83807 #2935

Closed Chetnamann closed 1 year ago

Chetnamann commented 1 year ago

This issue tracker is only for AODN Portal issues.

Steps to reproduce the issue

Add an ANMN timeseries to map on step one, proceed straight to step 3 and click download as CSV

Expected behaviour

Get the CSV and it has more than 1 million rows (however Excel won't actually open them all!)

https://github.com/aodn/aodn-portal/issues/2518

Actual behaviour

Tell us what happens instead

Screenshots.

Cannot see more than 1 million rows, or any notification to download data

What version of the aodn portal are you using?

4.42.96

Which browser are you using?

chrome

evacougnon commented 1 year ago

update, I ran this test on 22/02/2023, I could start the download without any issue. I had to stop the download before it completed but reached 23+ GB, I'll make sure the download finishes next time I run the test

craigrose commented 1 year ago

/home/craig/Downloads/IMOS_-_Australian_National_MooringNetwork(ANMN)Facility-_Temperature_and_salinity_time-series.csv.crdownload

craigrose commented 1 year ago

This test may need to be refactored to be more practical. ie try to avoid having to wait many hours to get the result?

craigrose commented 1 year ago

Updated the test to download a smaller file just over 1 million rows. This takes about 3 mins and is only 250MB.