glamod / glamod-ingest

Database preparation and ingestion for GLAMOD
BSD 2-Clause "Simplified" License
2 stars 1 forks source link

Test Hans feedback on slow query responses #72

Closed agstephens closed 3 years ago

agstephens commented 3 years ago

The downloading of sub daily data is extremely slow.

I ran a job over night and I only managed to download data from 1960 to 1965!

Total volume of that is 2.5 GByte in 10 hours. That's delivering about 70 kbyte/s on average.

How is that going to be for more recent data?

Why is this so slow?

agstephens commented 3 years ago

Dealt with in other issues.