search

AlphaSlayer1964 / kemono-dl

A simple kemono.party downloader using python.
508 stars 81 forks source link

I want to re-download only the posts that have an error during download. Is there a way? #9

Closed CODE-LA-LI-LU-LE-LO closed 2 years ago

CODE-LA-LI-LU-LE-LO commented 2 years ago

If an archive txt is generated even for a post with an error, it is recorded as being processed normally, and the file is missing because it is not downloaded again even if options such as -favorite-users are used. A function that attempts to re-download the post with an error by marking it separately in the archive is required.

In addition, you need an option to add an index to attachments and posts when downloading. (Currently, there is no additional index to the file name when downloading, and there is a problem that the order is mixed when sorting the file name)

AlphaSlayer1964 commented 2 years ago

Posts don't get recorded in your archive file if they encounter any errors. Just to be clear the index you are referring to is the order that they appear on patreon or kemono.party? I guess the problem with adding an index is that I would be changing the original uploaded file name, which shouldn't happen unless there are illegal windows characters.

CODE-LA-LI-LU-LE-LO commented 2 years ago

I tried it on kemono. Although they are downloaded in the order they were uploaded to the post, kemono randomly assigns file names, so there is a problem with the order of file names after they are downloaded. (That's why I say I need the index option)

I didn't know that files with errors during download are not saved in the archive. I think I misunderstood a post with a similar number… I'll check it again later. thanks.

AlphaSlayer1964 commented 2 years ago

can you give me an example? ie service, userid, postid Kemono.party may change the names on their front end but the api should have the correct uploaded name.

CODE-LA-LI-LU-LE-LO commented 2 years ago

I'll post those IDs and screenshots after I get home from work.🥲

AlphaSlayer1964 commented 2 years ago

ok np

CODE-LA-LI-LU-LE-LO commented 2 years ago

화면 캡처 2021-10-19 201308 Here's an example. service : fanbox userid : 11229342 postid : 2793058

As I check, the file name that has already been uploaded is in a strange state. The API seems to get the original file name normally. (The upload order is normal regardless of the file name.) However, since the file name is wrong in the first place, there is a problem with sorting the files after they are downloaded. :d Therefore, it seems necessary to add an index number according to the download order.

AlphaSlayer1964 commented 2 years ago

looking at the api those should be the correct file names. Though I don't have access to the original post to confirm. I guess I could add an flag to for add an index number to the file names.

AlphaSlayer1964 commented 2 years ago

ok made a new release that includes a new flag for preserving ordering. ver 2021.10.19