search

quince-science / QuinCe

QuinCe is an online tool for processing and quality control of data from scientific instruments, with a primary focus on oceanic data.
https://quince.science
GNU General Public License v3.0
7 stars 8 forks source link

Data extraction slow in large data set instrument #1445

Open squaregoldfish opened 5 years ago

squaregoldfish commented 5 years ago

On the live system, G O Sars has NRT data since March. Performing data extraction for a newly created small data set takes over 15 minutes.

My initial theory is that it's something to do with indexing, but that's based on nothing more than the MySQL process running flat out during that period.

squaregoldfish commented 5 years ago

Oddly, the re-extraction for the NRT dataset rebuild took only 4 minutes. Still a long time, but why is it shorter for a much bigger dataset?

MarenKK commented 4 years ago

1801