johanneszab
commented
7 years ago -
Force rescanning does not redownload anything. It's just scanning the whole blog instead of going only to the last saved post from a successful previous download. Thus, this option basically only updates the statistics (number of download, duplicates, ..) accordingly but might consume several minutes on large blogs. E.g. on a 200'000 posts blog if you've already downloaded 190'000 posts it would takes several minutes scanning the whole blog due to the rate limiting but not yield any new downloads. That's why the default scanning only scans the newest 10'000 posts but it cannot update the statistics right now. Even though I think there should be enough data in the databases to even reconstruct the number newly added duplicates in the "scan only new posts until the last date" and thus it would be possible to even update the statistics there.
I don't know why people keep asking this. For me it made no sense to implement a "re-download" option for deleted files. Why would I delete them in the first place? And with the directory scanning all you have to do for re-downloading deleted files is to delete the blog (index) and re-add it and just do the whole download again. Since it scans the the blog folder for already available files, it will only download missing files.
Taranchuk
Recently I often began to lose my Internet connection due to a bad internet provider, which led to the detection of bugs during the use of the program. 1) When the Internet disappears during downloading of images, the crawling does not stop and the program starts to create files with a zero size (0 bytes) until the crawling process does not end or the Internet connection does not resume. Also when I downloading image metadata and during this happens the loss of Internet connection then the program does not add anything to the metadata files, but the process goes on until the end of crawling so after this I get unfinished metadata files. It would be very nice if you could do so that the crawling stopped, as soon as the Internet connection disappears, for me it's a little uncomfortable to delete files with a zero size every time when Internet connection disappears and again put these blogs on the queue panel. 2) I found that the function of checking directories for files does not work for me when I need to download not downloaded files and files that I have already deleted (for example, the same files with a zero size). I put blogs on the queue panel with functions of forced scanning, checking directories for files and downloading files with a specific size (1280) and at first the program downloads new posts that were added to the Tumblr blogs after the last download, but after this the program does not download deleted files and remained files that should have downloaded. As soon as the process goes to the end the blogs just stops, they does not leave the queue panel and does not free up space for the following blogs (similar thing happened to me 2 weeks ago with downloading image metadata before release the fix https://github.com/johanneszab/TumblThree/issues/113). So since the function of downloading deleted and non-downloaded files is currently does not work properly for me, I have to use the list of links, delete all existing files from the list and download these files by using another downloader program. And if it somehow helps to clarify the situation, then to everything above written I will add that I use the latest version of the program, I use Windows 7 and .NET Framework 4.0.3 version 64bit, I download only images with a specific size and image metadata from NSFW blogs, all files are downloaded in a separate folder on another disk, not in Tumblthree folder, which lies on the C:\ drive. Also here is a screenshot of the program settings: http://i.imgur.com/BtDUqjs.jpg