While downloading something with wget, it seems that it creates a dummy file even if it fails to download anything. This file is now cleaned up properly in download_file(). This happened for some covers.
Added verbose logging to zimwriterfs
Previously, even if something was downloaded successfully from optimization cache, the scraper went on to check other URLs and download. This is fixed with proper break statements.
Books that could not be downloaded in any format are now removed from DB to prevent errors being thrown at the time of exporting.
This does the following -
While downloading something with wget, it seems that it creates a dummy file even if it fails to download anything. This file is now cleaned up properly in download_file(). This happened for some covers.
Added verbose logging to zimwriterfs
Previously, even if something was downloaded successfully from optimization cache, the scraper went on to check other URLs and download. This is fixed with proper break statements.
Books that could not be downloaded in any format are now removed from DB to prevent errors being thrown at the time of exporting.