Bionus / imgbrd-grabber

Very customizable imageboard/booru downloader with powerful filenaming features.
https://www.bionus.org/imgbrd-grabber/
Apache License 2.0
2.57k stars 220 forks source link

Danbooru.donmai.us no longer working? #541

Closed foxkitsune006 closed 8 years ago

foxkitsune006 commented 8 years ago

2 or 3 days ago I tried downloading images from danbooru. I download about 5000 images and left it for 3 hours or so. when I check my download folder, it seems the grabber is working normally, but the images are corrupt. after that, i restart the grabber, and even re-install it. I tried to re-download the whole thing, only to find that i can't search anything from danbooru anymore. I tried searching something from safebooru and it works just fine. Is it just my grabber problem? or the danbooru is not useable anymore?

Bionus commented 8 years ago

Danbooru is working fine for me (without credentials and using default settings).

Could you upload your main.log file? (in "%localappdata%/Bionus/Grabber") As well as one of those corrupt images? (they likely contain plain text so you could also just open one with notepad and copy and paste the contents)

foxkitsune006 commented 8 years ago

sorry, but i already deleted those corrupt image. and i don't see any main.log files here... Am I doing this wrong? =w='a

Bionus commented 8 years ago

There has to be a min.log file in C:\Users\%USERNAME%\AppData\Local\Bionus\Grabber if you started the program at least once. If not, you can open this folder directly from the program using the menu "File > Open settings folder". Not that this log file is cleared every time you start the program, so it's only useful if uploaded directly after a bug.

As for the corrupt images, if the bug persits, maybe you can download one or two new ones?

What's the file size of these images?

foxkitsune006 commented 8 years ago

I can't download from danbooru anymore. whenever I search i shows no result. anyway, I already re installed my grabber after the danbooru stopped working for me, so the main.log file probably isn't recording anything when the grabber download those corrupt images. anyway here. main file. sorry for the wait. I misunderstand the file location lol

foxkitsune006 commented 8 years ago
[13:28:28.474] New session started.
[13:28:28.476] Software version: 4.5.3.
[13:28:28.477] Path: C:/Program Files (x86)/Grabber
[13:28:28.479] Loading preferences from C:\Users\Josua D\AppData\Local\Bionus\Grabber\settings.ini
[13:28:28.679] Loading sources
[13:28:28.831] %n source(s) found: behoimi.org (Danbooru), chan.sankakucomplex.com (Sankaku), danbooru.donmai.us (Danbooru (2.0)), derpibooru.org (Booru-on-rails), e621.net (Danbooru), gelbooru.com (Gelbooru (0.2)), hijiribe.donmai.us (Danbooru (2.0)), ichijou.org (Danbooru), idol.sankakucomplex.com (Sankaku), konachan.com (Moebooru), rule34.paheal.net (Shimmie), rule34.xxx (Gelbooru (0.2)), safebooru.org (Gelbooru (0.2)), sonohara.donmai.us (Danbooru (2.0)), tentaclerape.net (Shimmie), www.zerochan.net (Zerochan), yande.re (Moebooru)
[13:28:28.906] Updating "New tab" tab options.
[13:28:28.907] Updating checkboxes.
[13:28:28.928] Updating "New tab" tab options.
[13:28:28.929] Updating checkboxes.
[13:28:29.115] Fin de l'initialisation.
[13:28:32.574] Loading results...
[13:28:32.626] Loading page https://danbooru.donmai.us/posts.xml?limit=20&page=1&tags=
[13:28:56.202] Loading results...
[13:28:56.249] Loading page https://danbooru.donmai.us/posts.xml?limit=20&page=1&tags=blazblue
[13:29:16.295] Loading error: Connection timed out
[13:29:16.296] Loading using xml failed. Retry using json.
[13:29:27.676] Loading results...
[13:29:27.681] Loading page https://danbooru.donmai.us/posts.xml?limit=20&page=1&tags=blazblue
[13:29:44.983] Loading results...
[13:29:45.006] Loading page https://danbooru.donmai.us/posts.xml?limit=20&page=1&tags=blazblue
[13:29:58.322] Loading error: Connection timed out
[13:29:58.323] Loading using xml failed. Retry using json.
[13:30:09.696] Loading error: Connection timed out
[13:30:09.697] Loading using json failed. Retry using regex.
[13:30:29.820] Loading results...
[13:30:29.822] Loading page https://danbooru.donmai.us/posts.xml?limit=20&page=1&tags=blazblue
[13:30:29.824] Loading page http://safebooru.org/index.php?page=dapi&s=post&q=index&limit=20&pid=0&tags=blazblue
[13:30:30.834] Receiving page http://safebooru.org/index.php?page=dapi&s=post&q=index&limit=20&pid=0&tags=blazblue
[13:30:37.017] Loading results...
[13:30:37.056] Loading page https://danbooru.donmai.us/posts.xml?limit=20&page=1&tags=blazblue
[13:30:40.350] Loading error: Connection timed out
[13:30:40.351] Loading using xml failed. Retry using json.
[13:31:11.825] Loading error: Connection timed out
[13:31:11.826] Loading using json failed. Retry using regex.
[13:31:22.368] Loading error: Connection timed out
[13:31:22.369] No valid source of the site returned result.
[13:42:26.586] Saving...
Bionus commented 8 years ago

It says Connection timed out, so it looks like the page loading is getting blocked at a higher level. Are you behind a proxy, a VPN or some kind of restricting software?

Can you access https://danbooru.donmai.us/ (NSFW) from a normal browser such as Firefox, Chrome or IE with no issues?

You can try setting the proxy options in Grabber to use some external proxy and see if it works.

Bionus commented 8 years ago

Closing for lack of updates, feel free to reopen.