happypandax / plugins

Plugins for HappyPanda X
https://happypandax.github.io/
GNU Lesser General Public License v3.0
32 stars 16 forks source link

Ban prevention system for metadata queue. #17

Closed mrskizzex closed 5 years ago

mrskizzex commented 5 years ago

When i tried querying metadata for my doujins ( 2600 or so ), after around 500 i was struck with a ban hammer on exhentai. I had every delay on default as that happened.

That got me thinking about possible resolutions to this problem. I'm listing them in no particular order and you can add them all or only some of them.

  1. Add a warning notification when adding many, lets say above 200-300 doujins to metadata queue that you can be struck with a ban hammer.
  2. Add logic to the metadata queue so it notices when you get a warning page on exhentai, I forget about specifics but it says something along these lines "you are doing this too much, if you continue you will be temp banned." and dissapears after few minutes. When that would be detected queue would initiate cooldown of for example 60 minutes and then resume until another warning.
  3. Same as above but hardcode limit of 200-300 doujins between 60 minutes cooldowns.

Edit: First ban was 24h after around 500 doujins Second ban was 3 days after around 100 doujins. fun stuff.

You should get in touch with Tenboro and work out safe values for this.

twiddli commented 5 years ago

With the revamped metadata system things should now work better. With my own trials, I didn't experience a ban with the default settings set now even after extensive use. Please re-open if this is not the case.