search

stumpapp / stump

A free and open source comics, manga and digital book server with OPDS support (WIP)
https://stumpapp.dev
MIT License
863 stars 34 forks source link

Refactor parallel scan end logic #169

Closed aaronleopold closed 9 months ago

aaronleopold commented 9 months ago

The parallel scanner (to be renamed Quick scanner) is more efficient and speedy than the in-order scanner (to be renamed Default scanner TBD). However, at the very end of the scan it gets out of the parallelism pattern and becomes a bit of a slow hog.

It needs to be refactored to parallelize and batch at the end, as to cut down on memory usage and increase the speed.

DieselTech commented 9 months ago

To go with that, clear indication that it's done with the scanning and moved into the processing phase. That way it doesn't look like it's stuck in a phase.

aaronleopold commented 9 months ago

Closing after our discussion on Discord (removing the separation of scanners for the time being)