add all releases for my favorite stars to the download list, not just recent releases

[pdbme]

A user is asking if there is a way to do an initial run to add all releases that can be found for the star to the download list?

[tblotko]

Thanks for adding the support. Appreciate it! What does this failure mean after starting the backfilling task?

[pdbme]

Probably a bug that I could just fix by hardening calls to Addrange.

Please download the v0.3 again and replace your current pdbMate.exe file with the newly downloaded one.

[tblotko]

ok thanks, now there is no failure but the downloads aren't added to nzbget.

[pdbme]

Before adding to nzbget begins there should be a log message like:

.. releases after Filter: remove duplicates.

That's the number of releases that will be added. How many to you have there?

For each release there then should be messages like:

Add ..... to download list .... Add to nzbget: ....

Do you have any of these loggings in verbose-mode?

[tblotko]

That's all I get with the backfilling command:

[pdbme]

Looking at your console output and the source code, I don't really see how this is possible.

I put in some more log-messages and uploaded the win-64 exe to the v0.3 release. Please download the version and try again and post the output of the console.

I fixed nothing so the end result should be the same.

[tblotko]

There is no difference in the output of the console after replacing the win-64.exe .

[tblotko]

I've found out that it adds downloads to the list if I say yes to "Do backfilling for all yout favorite sites?". But it than only adds downloads to the list from my favorite sites and not for the actors.

[tblotko]

@pdbme Anything new regarding this behavior?

[pdbme]

I tested with the latest version and got this result on my own test (one favorite actor and one favorite site - only nzbprn as indexer):

It went just fine working only with the actors.

[pdbme]

For the latest console output please update to pdbMate-v0.3-win-x64-fixed.zip from the release section.

[tblotko]

That's the complete output I get after the update to the fixed version:

Also this is only a fraction of the actors I added to favorites. Is it maybe a problem with nzbget?

[pdbme]

No it's not nzbget related. I was finally able to reproduce the problem.

I'm looking into it.

[pdbme]

Okay logging was broken and I found the bug. Before I release the new version, we should discuss another problem when testing with your account:

pdbMate would try to add thousands of nzb files to your nzbget. This might work, but I guess this might crash sabnzbd or nzbget. Besides downloading will take forever and many of the older releases won't be available on usenet anymore.

So I was wondering how we should limit the number of releases that are selected.

Two options come to mind:

• Add only releases that are not older than X days.
• Add only the newest X releases per actor.

Another possibility would be to go one by one regarding the actors. So you could only backfill one actor at a time.

Would one of these options suite your needs? What exactly are you trying to accomplish with backfilling?

[tblotko]

That sounds good! I think this option would be good: "Add only releases that are not older than X days." I just want to fill a NAS with a bunch of releases of my favorite stars.

Did you also found out why it wasn't adding releases for every actor? I have like ~100 favorite actors on porndb and it only says that it adds releases for 6 actors.

Are you also the developer of porndb? If so, there can I ask you questions about it?

[pdbme]

The release version 0.3.1 contains all the bugfixes you need and interactive setup now enables you to set the daysback argument. Which makes: "Add only releases that are not older than X days" happen.

The problem with the actors list was, that it did throw error messages but didn't display them and it exited the whole actors queue once there was an actor for which no releases could be found. I fixed these problems and it works now even for hundreds of actors.

I'm not the developer of porndb but I'm in contact with him. You can reach out to him by the support form and he will respond to you by email (ongoing conversations are then by email).

[tblotko]

Thank you but I now get this error message:

[pdbme]

Please try again. The API was down, it's back up again.

[tblotko]

Now I get this error:

And isn't a total of 195 releases a bit low for all the releases that were added for the actors?

[tblotko]

It hast to do something with the number of days. It didn't work for 100 days but it worked for 10 days.

[tblotko]

@pdbme How does the backfilling handle already downloaded files? It seems like there is no check if it was already downloaded. Normally when you add a NZB file to nzbget it will check for duplicates. Can you use this check when pdbMate adds the files to nzbget?

[pdbme]

I fixed the issue you experienced. 100 days work now.

Regarding your question:

The target directory for renaming is scanned. So downloads previously done by autopilot mode with renaming active are considered.

You can also let pdbMate rename existing files and once they are in the target directory and correctly attributed in the filename with an ID, backfilling will recognize those files and not download them again.

When backfilling your nzbget download queue and your history are checked against identical releases. So you do not download the same release from porndb twice. BUT this function does not try do recognize normal duplicates from other sources or previous downloads that are found in your queue.

[tblotko]

Thank you. Actually it doesn't check against the nzbget history through the backfilling. I think the problem is the download are added to nzbget as RSS links and nzbget still fetches them. If I do the backfilling again it will download the same releases as befor with no duplicate check.

One other question since the update I get a lot of these messages when I use the rename function. What exactly do they mean, what does pdbMate check here? The videos are still in the folder.

[pdbme]

Yes you need to wait until all downloads are correctly loaded or fetched as nzb files before running backfilling again.

Anyway the backfilling is more a one-time usage feature. For continues downloading there is the normal autopilot mode.

No video found means that these wasn't any matching video found (done by release scene title matching).

[tblotko]

That's what I did. But nzbget will not do a check against the history and just downloads the file again. But thank you anyways for the great application!

[tblotko]

I'm correcting myself with the fixed version the history check seems to work. Thank you

[tblotko]

You can close this. But I have one feature request: Backfilling for only a specified actor.

[pdbme]

Luckily this is already possible by command line:

pdbMate backfilling --client nzbget --actor 9999 --daysback 30

You have to replace 9999 by the actor id you want to backfill.

If you have additional feature requests please add a new issue.

[tblotko]

Thank you. Is there an easy way to find out the actor id?