search

Bionus / imgbrd-grabber

Very customizable imageboard/booru downloader with powerful filenaming features.
https://www.bionus.org/imgbrd-grabber/
Apache License 2.0
2.57k stars 220 forks source link

Derpibooru.org - Problem with the downloaded images and quantity. #1162

Closed lDeadlyIllusion closed 2 years ago

lDeadlyIllusion commented 6 years ago

What steps will reproduce the problem?

  1. Go to do my search
  2. Put the tag of the artist
  3. Finally with my previous problem now fixed, the results are complete (1100 images)
  4. Go to "Get this page" then "Downloads" and i download the files.

What is the expected behavior? What do you get instead?

I expect the download of the 50 images without any problem. Instead i get this: 3 Only i get 15 elements and incomplete with the size 185 bytes in all.

How often does this problem occur? On which sources?

Always on Derpibooru.org

What version of the program are you using? On what operating system?

5.5.2 / Windows 10

Please provide any additional information below

Here i'm trying to download the 1100 images but i get the same result only that the window doesn't close after clicking on OK. And on that try only downloaded 330/330 images and not the 1100 images. 1 HERE'S THE LOG: main.log

Gaffnet commented 6 years ago

Check those image files in a text editor. They're probably HTML server error pages that were downloaded by Grabber.

I tried downloading a batch from Derpibooru and got the same result.

This is what was in the "corrupt image" files I downloaded:

<head><title>301 Moved Permanently</title></head>
<body bgcolor="white">
<center><h1>301 Moved Permanently</h1></center>
<hr><center>nginx/1.10.3</center>
</body>
</html>

What I've found is that any attempt at a batch download using Grabber on Derpibooru yields the above result. This happens with all batch creation methods. I.e. "Get Page", "Get All" or "Get Selected."

Images saved individually were saved correctly most of the time during my test sessions, but I did get some 301 errors during individual image saves as well.

Here i'm trying to download the 1100 images...

I'd recommend exercising some restraint. It's this sort of thing that will get Grabber banned.

lDeadlyIllusion commented 6 years ago

They are not server errors. and yes, we have the same problem.

Gaffnet commented 6 years ago

They are not server errors.

When those server error pages are saved, they're exactly 185 bytes; the same file size as you mentioned.

If you open those failed downloaded images in a text editor, what's shown?

lDeadlyIllusion commented 6 years ago

This 1.txt

MasterPetrik commented 6 years ago

They are not server errors.

You are wrong. That's a server errors indeed, with exactly the same text as @Gaffnet said:

301 Moved Permanently

301 Moved Permanently

nginx/1.10.3

@Bionus old problem with saving redirects/error server ansvers as images, huh. Just like in https://github.com/Bionus/imgbrd-grabber/issues/1038 maybe need to check, is somewhere else in grabber server ansvers processes incorrect too?, to prevent such problems in the future.

lDeadlyIllusion commented 6 years ago

So... There's no fix?

stale[bot] commented 2 years ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.

If this issue is about a bug that still happens in the latest version, or a suggestion that is still relevant, feel free to comment on it and the maintainers will have another look, they might have missed it!

Thank you!