daisy / pipeline-webui

A Web User Interface for the DAISY Pipeline 2
Other
3 stars 2 forks source link

Slow download all results #135

Open PaulRambags opened 4 years ago

PaulRambags commented 4 years ago

As a user of the Web UI, I would like that file results.zip appears within seconds after I've pushed the Download all results button, so that I don't have to wait for minutes.

I processed a large DTBook - it is 2.5 MB in size and produces a PEF with 63 volumes and more than 3700 pages. Then when I push the Download all results button I have to wait more than 5 minutes before I receive the results.zip. In the meanwhile, the Web UI takes maximum CPU. If I get the results from the Pipeline 2 with dp2 results, then ZIP the results with 7-Zip and transfer the resulting ZIP file with copy-and-paste to my local machine, it takes me only a few seconds.

I suspect that the Web UI uses an inefficient ZIP library.