search

Bionus / imgbrd-grabber

Very customizable imageboard/booru downloader with powerful filenaming features.
https://www.bionus.org/imgbrd-grabber/
Apache License 2.0
2.55k stars 216 forks source link

Grabber isn't adding image data to local MySQL database(WampServer 2.2e, Gelbooru 0.1.11, Grabber 4.6.0) #594

Closed Shir01 closed 8 years ago

Shir01 commented 8 years ago

Hi Bionus.

Though, it seems that the previously mentioned issue(#577) is solved with the update to 4.6.0 version, Grabber is still unable to add images to the local version of gelbooru. To be exact, Grabber is not adding appropriate data(tags, etc) to the database for some reason. Grabber log shows that there was an error([18:09:57.367] line) while initializing commands and that's all. Here is full log:

[18:09:15.183] New session started.
[18:09:15.183] Software version: 4.6.0.
[18:09:15.183] Path: C:/Program Files (x86)/Grabber
[18:09:15.183] Loading preferences from C:\Users\user\AppData\Local\Bionus\Grabber\settings.ini
[18:09:15.185] Loading sources
[18:09:15.203] %n source(s) found: behoimi.org (Danbooru), chan.sankakucomplex.com (Sankaku), danbooru.donmai.us (Danbooru (2.0)), derpibooru.org (Booru-on-rails), e621.net (Danbooru), gelbooru.com (Gelbooru (0.2)), hijiribe.donmai.us (Danbooru (2.0)), ichijou.org (Danbooru), idol.sankakucomplex.com (Sankaku), konachan.com (Moebooru), rule34.paheal.net (Shimmie), rule34.xxx (Gelbooru (0.2)), safebooru.org (Gelbooru (0.2)), sonohara.donmai.us (Danbooru (2.0)), tentaclerape.net (Shimmie), www.zerochan.net (Zerochan), yande.re (Moebooru)
[18:09:15.203] It seems that Imgbrd-Grabber hasn't shut down properly last time.
[18:09:16.557] Logging into Gelbooru (gelbooru.com)...
[18:09:17.110] Updating "New tab" tab options.
[18:09:17.110] Updating checkboxes.
[18:09:17.155] Fin de l'initialisation.
[18:09:17.350] Logging into Gelbooru (gelbooru.com) finished (success).
[18:09:17.363] Updating "New tab" tab options.
[18:09:17.363] Updating checkboxes.
[18:09:49.230] Loading results...
[18:09:49.230] Loading page http://gelbooru.com/index.php?page=dapi&s=post&q=index&limit=20&pid=0&tags=guweiz horns
[18:09:49.329] Parse
[18:09:49.329] Receiving page http://gelbooru.com/index.php?page=dapi&s=post&q=index&limit=20&pid=0&tags=guweiz horns
[18:09:57.348] Batch download started.
[18:09:57.367] Error while initializing commands
[18:09:57.367] SQL execution of """"
[18:09:57.374] Loading images 'http://gelbooru.com/index.php?page=dapi&s=post&q=index&limit=3&pid=0&tags=guweiz horns'
[18:09:57.434] Parse
[18:09:57.439] Received image page 'http://gelbooru.com/index.php?page=dapi&s=post&q=index&limit=3&pid=0&tags=guweiz horns' (3)
[18:09:57.440] All images' urls have been received (3 images).
[18:09:57.446] Downloading images directly.
[18:09:57.450] Loading image from http://gelbooru.com/images/fe/c1/fec14954b4bae044ecb354d3c4f56db1.jpg 1
[18:09:57.651] Image received from http://gelbooru.com/images/fe/c1/fec14954b4bae044ecb354d3c4f56db1.jpg 1
[18:09:57.654] Execution of """"
[18:09:57.654] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("1girl", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.654] Execution of """"
[18:09:57.654] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("animal", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.654] Execution of """"
[18:09:57.654] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("armor", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.654] Execution of """"
[18:09:57.654] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("artist_name", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.654] Execution of """"
[18:09:57.654] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("black_hair", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.654] Execution of """"
[18:09:57.654] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("blue_ribbon", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.654] Execution of """"
[18:09:57.654] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("blurry", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.655] Execution of """"
[18:09:57.655] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("breasts", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.655] Execution of """"
[18:09:57.655] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("broken_cup", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.655] Execution of """"
[18:09:57.655] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("butterfly", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.655] Execution of """"
[18:09:57.655] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("chains", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.655] Execution of """"
[18:09:57.655] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("cleavage", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.655] Execution of """"
[18:09:57.655] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("clenched_hand", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.655] Execution of """"
[18:09:57.655] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("closed_mouth", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.655] Execution of """"
[18:09:57.655] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("cup", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.655] Execution of """"
[18:09:57.655] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("demon_girl", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.655] Execution of """"
[18:09:57.655] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("demon_horns", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.655] Execution of """"
[18:09:57.655] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("depth_of_field", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.656] Execution of """"
[18:09:57.656] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("dragon", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.656] Execution of """"
[18:09:57.656] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("earrings", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.656] Execution of """"
[18:09:57.656] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("expressionless", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.656] Execution of """"
[18:09:57.656] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("floating_hair", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.656] Execution of """"
[18:09:57.656] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("glasses", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.656] Execution of """"
[18:09:57.656] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("glowing", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.656] Execution of """"
[18:09:57.656] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("guweiz", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.656] Execution of """"
[18:09:57.656] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("highres", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.656] Execution of """"
[18:09:57.656] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("holding", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.656] Execution of """"
[18:09:57.656] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("holding_cup", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.656] Execution of """"
[18:09:57.656] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("horn_ornament", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.656] Execution of """"
[18:09:57.656] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("horn_ribbon", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.656] Execution of """"
[18:09:57.656] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("horns", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.656] Execution of """"
[18:09:57.656] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("insect", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.656] Execution of """"
[18:09:57.656] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("jewelry", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.656] Execution of """"
[18:09:57.656] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("long_hair", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.656] Execution of """"
[18:09:57.656] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("looking_at_viewer", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.656] Execution of """"
[18:09:57.656] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("medium_breasts", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.656] Execution of """"
[18:09:57.656] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("monster", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.656] Execution of """"
[18:09:57.656] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("necklace", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.658] Execution of """"
[18:09:57.658] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("orange_eyes", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.658] Execution of """"
[18:09:57.658] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("original", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.658] Execution of """"
[18:09:57.658] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("pendant", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.658] Execution of """"
[18:09:57.658] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("pink_lips", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.658] Execution of """"
[18:09:57.658] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("rain", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.658] Execution of """"
[18:09:57.658] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("ribbon", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.658] Execution of """"
[18:09:57.658] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("round_glasses", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.658] Execution of """"
[18:09:57.658] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("sharp_teeth", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.658] Execution of """"
[18:09:57.658] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("shoulder_pads", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.658] Execution of """"
[18:09:57.658] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("solo", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.658] Execution of """"
[18:09:57.658] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("teacup", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.658] Execution of """"
[18:09:57.658] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("teeth", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.658] Execution of """"
[18:09:57.658] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("very_long_hair", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.658] Execution of """"
[18:09:57.658] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("water", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.658] Execution of """"
[18:09:57.658] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("wind", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.658] Execution of """"
[18:09:57.658] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("yellow-framed_eyewear", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.660] Execution of "C:\Windows\System32\cmd.exe /C copy "C:\00\fec14954b4bae044ecb354d3c4f56db1.jpg" "C:\w64\www\gelbooru\images\1\fec14954b4bae044ecb354d3c4f56db1.jpg""
[18:09:57.680] SQL execution of "INSERT INTO posts(creation_date, hash, image, height, width, ext, rating, tags, directory, active_date) VALUES(NOW(), "fec14954b4bae044ecb354d3c4f56db1", "fec14954b4bae044ecb354d3c4f56db1.jpg", 918, 1600, ".jpg", "safe", " 1girl animal armor artist_name black_hair blue_ribbon blurry breasts broken_cup butterfly chains cleavage clenched_hand closed_mouth cup demon_girl demon_horns depth_of_field dragon earrings expressionless floating_hair glasses glowing guweiz highres holding holding_cup horn_ornament horn_ribbon horns insect jewelry long_hair looking_at_viewer medium_breasts monster necklace orange_eyes original pendant pink_lips rain ribbon round_glasses sharp_teeth shoulder_pads solo teacup teeth very_long_hair water wind yellow-framed_eyewear ", "1", "20110619");"
[18:09:57.686] Loading image from http://gelbooru.com/images/72/22/72223d32cdf598856b3b2cb7b39a77b3.jpg 1
[18:09:57.689] Image received from http://gelbooru.com/images/72/22/72223d32cdf598856b3b2cb7b39a77b3.jpg 1
[18:09:57.691] Execution of """"
[18:09:57.691] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("1girl", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.691] Execution of """"
[18:09:57.691] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("artist_name", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.691] Execution of """"
[18:09:57.691] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("black_dress", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.691] Execution of """"
[18:09:57.691] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("blue_hair", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.692] Execution of """"
[18:09:57.692] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("breasts", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.692] Execution of """"
[18:09:57.692] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("cleavage", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.692] Execution of """"
[18:09:57.692] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("cleavage_cutout", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.692] Execution of """"
[18:09:57.692] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("demon", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.692] Execution of """"
[18:09:57.692] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("dress", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.692] Execution of """"
[18:09:57.692] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("earrings", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.692] Execution of """"
[18:09:57.692] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("female", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.692] Execution of """"
[18:09:57.692] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("glowing", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.692] Execution of """"
[18:09:57.692] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("guweiz", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.692] Execution of """"
[18:09:57.692] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("horns", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.692] Execution of """"
[18:09:57.692] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("injury", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.692] Execution of """"
[18:09:57.692] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("jewelry", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.692] Execution of """"
[18:09:57.692] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("looking_afar", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.693] Execution of """"
[18:09:57.693] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("looking_up", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.693] Execution of """"
[18:09:57.693] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("medium_breasts", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.693] Execution of """"
[18:09:57.693] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("motion_blur", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.693] Execution of """"
[18:09:57.693] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("necklace", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.693] Execution of """"
[18:09:57.693] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("orange_eyes", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.693] Execution of """"
[18:09:57.693] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("parted_lips", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.693] Execution of """"
[18:09:57.693] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("pendant", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.693] Execution of """"
[18:09:57.693] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("pointy_ears", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.693] Execution of """"
[18:09:57.693] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("portrait", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.693] Execution of """"
[18:09:57.693] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("rain", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.693] Execution of """"
[18:09:57.693] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("red_lips", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.693] Execution of """"
[18:09:57.693] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("short_hair", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.693] Execution of """"
[18:09:57.693] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("solo", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.693] Execution of """"
[18:09:57.693] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("upper_body", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.694] Execution of """"
[18:09:57.694] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("water", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.694] Execution of """"
[18:09:57.694] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("water_drop", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.695] Execution of "C:\Windows\System32\cmd.exe /C copy "C:\00\72223d32cdf598856b3b2cb7b39a77b3.jpg" "C:\w64\www\gelbooru\images\1\72223d32cdf598856b3b2cb7b39a77b3.jpg""
[18:09:57.711] SQL execution of "INSERT INTO posts(creation_date, hash, image, height, width, ext, rating, tags, directory, active_date) VALUES(NOW(), "72223d32cdf598856b3b2cb7b39a77b3", "72223d32cdf598856b3b2cb7b39a77b3.jpg", 1101, 900, ".jpg", "safe", " 1girl artist_name black_dress blue_hair breasts cleavage cleavage_cutout demon dress earrings female glowing guweiz horns injury jewelry looking_afar looking_up medium_breasts motion_blur necklace orange_eyes parted_lips pendant pointy_ears portrait rain red_lips short_hair solo upper_body water water_drop ", "1", "20110619");"
[18:09:57.711] Loading image from http://gelbooru.com/images/b7/f7/b7f7c3952d8b375ef9d35f1e945ba148.png 1
[18:09:57.711] Image received from http://gelbooru.com/images/b7/f7/b7f7c3952d8b375ef9d35f1e945ba148.png 1
[18:09:57.711] Execution of """"
[18:09:57.711] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("1girl", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.711] Execution of """"
[18:09:57.711] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("arm_up", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.711] Execution of """"
[18:09:57.711] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("ass", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.711] Execution of """"
[18:09:57.711] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("black_hair", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.711] Execution of """"
[18:09:57.711] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("boots", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.711] Execution of """"
[18:09:57.711] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("breasts", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.711] Execution of """"
[18:09:57.711] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("cleavage", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.711] Execution of """"
[18:09:57.711] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("destruction", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.711] Execution of """"
[18:09:57.711] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("gradient", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.711] Execution of """"
[18:09:57.711] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("gradient_background", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.711] Execution of """"
[18:09:57.711] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("guweiz", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.711] Execution of """"
[18:09:57.711] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("horns", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.711] Execution of """"
[18:09:57.711] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("kill_la_kill", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.711] Execution of """"
[18:09:57.711] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("lens_flare", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.711] Execution of """"
[18:09:57.711] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("matoi_ryuuko", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.711] Execution of """"
[18:09:57.711] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("midriff", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.711] Execution of """"
[18:09:57.711] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("miniskirt", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.711] Execution of """"
[18:09:57.711] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("motion_blur", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.727] Execution of """"
[18:09:57.727] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("multicolored_hair", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.727] Execution of """"
[18:09:57.727] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("navel", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.727] Execution of """"
[18:09:57.727] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("revealing_clothes", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.727] Execution of """"
[18:09:57.727] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("scissor_blade", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.727] Execution of """"
[18:09:57.727] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("senketsu", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.727] Execution of """"
[18:09:57.727] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("short_hair", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.727] Execution of """"
[18:09:57.727] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("skirt", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.727] Execution of """"
[18:09:57.727] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("solo", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.727] Execution of """"
[18:09:57.727] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("stomach", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.727] Execution of """"
[18:09:57.727] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("sunlight", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.727] Execution of """"
[18:09:57.727] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("suspenders", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.727] Execution of """"
[18:09:57.727] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("sword", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.727] Execution of """"
[18:09:57.727] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("thigh_boots", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.727] Execution of """"
[18:09:57.727] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("thighhighs", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.727] Execution of """"
[18:09:57.727] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("two-tone_hair", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.727] Execution of """"
[18:09:57.727] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("underboob", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.727] Execution of """"
[18:09:57.727] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("upper_body", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.727] Execution of """"
[18:09:57.727] SQL execution of "INSERT INTO tag_index(tag, index_count) VALUES("weapon", 1) ON DUPLICATE KEY UPDATE index_count = index_count+1;"
[18:09:57.727] Execution of "C:\Windows\System32\cmd.exe /C copy "C:\00\b7f7c3952d8b375ef9d35f1e945ba148.png" "C:\w64\www\gelbooru\images\1\b7f7c3952d8b375ef9d35f1e945ba148.png""
[18:09:57.750] SQL execution of "INSERT INTO posts(creation_date, hash, image, height, width, ext, rating, tags, directory, active_date) VALUES(NOW(), "b7f7c3952d8b375ef9d35f1e945ba148", "b7f7c3952d8b375ef9d35f1e945ba148.png", 900, 900, ".png", "safe", " 1girl arm_up ass black_hair boots breasts cleavage destruction gradient gradient_background guweiz horns kill_la_kill lens_flare matoi_ryuuko midriff miniskirt motion_blur multicolored_hair navel revealing_clothes scissor_blade senketsu short_hair skirt solo stomach sunlight suspenders sword thigh_boots thighhighs two-tone_hair underboob upper_body weapon ", "1", "20110619");"
[18:09:57.753] Images download finished.
[18:10:04.508] SQL execution of "UPDATE post_count SET pcount = (SELECT COUNT(*) FROM posts), last_update = (CURDATE() + 0) WHERE access_key = "posts";"
[18:10:04.508] Batch download finished

Could you please investigate this?

What steps will reproduce the problem?

  1. Configure Grabber, WampServer and Gelbooru the same way as described in the WIKI( https://github.com/Bionus/imgbrd-grabber/wiki/Gelbooru ) with the exception of this line in config.php: $mysql_user = "root"; It is not mentioned in the original manual, though without this change Gelbooru can't create new database or access an existing one.
  2. Download a batch of images.

    What is the expected behavior? What do you get instead?

According to the WIKI every time I download a pack of images, they will be added to local version of Gelbooru running on the WampServer, but Grabber only copies images to the image directory in Gelbooru folder without adding any records to the database.

What version of the program are you using? On what operating system?

Guest OS running on VMware Windows 8.1(9600) x64 Grabber 4.6.0 WampServer 2.2e x64 (https://sourceforge.net/projects/wampserver/files/WampServer%202/WampServer%202.2/wampserver2.2e/wampserver2.2e-php5.4.3-httpd-2.4.2_PATCH001-x64.exe/download) Gelbooru 0.1.11

Host OS Windows 7 SP1(7601) x64 Grabber 4.6.0 WampServer 3.0.4 x64 apache2.4.18 mysql5.7.11 php5.6.19 (https://sourceforge.net/projects/wampserver/files/WampServer%203/WampServer%203.0.0/wampserver3.0.4_x64_apache2.4.18_mysql5.7.11_php5.6.19-7.0.4.exe/download) Gelbooru 0.1.11

Flat commented 8 years ago

While this doesn't help with your Gelbooru issue, just a suggestion for someone who's tried the Gelbooru route. Gelbooru's source is old and they haven't made a new source release in quite a while.

If you do not already have images added to gelbooru consider setting up https://github.com/moebooru/moebooru instead.

You can then use curl -F "login=username" -F "password_hash=passwordhash" -F "post[tags]=%allo%" -F "post[file]=@%path%" -F "post[rating]=%rating%" localhost:8080/post/create as your image command to add the images through the API. This generates thumbnails properly and correctly adds tags to each image. Since you're running windows you'll likely also need to get curl for windows, but that shouldn't be too difficult.

ghost commented 8 years ago

This works fine with the tutorials in the wiki: https://github.com/zixaphir/gelbooru-fork, although I execute the SQL manually.

Shir01 commented 8 years ago

@barryanders

This works fine with the tutorials in the wiki: https://github.com/zixaphir/gelbooru-fork, although I execute the SQL manually.

Frankly speaking, I wasn't able to find any tutorial by following the link above, except maybe a small readme file in the "install" folder. None the less, I tried gelbooru-fork, the gelbooru itself works fine, but it is still impossible to add data to MySQL database using Grabber. Thanks anyway.

@Flat

You can then use curl -F "login=username" -F "password_hash=passwordhash" -F "post[tags]=%allo%" -F "post[file]=@%path%" -F "post[rating]=%rating%" localhost:8080/post/create as your image command to add the images through the API. This generates thumbnails properly and correctly adds tags to each image. Since you're running windows you'll likely also need to get curl for windows, but that shouldn't be too difficult.

Thanks for the suggestion. Could you explain to me in more detail where does this command get corresponding tags and file paths?

Flat commented 8 years ago

The command is run through Grabber as seen here 2016-08-26-17 20 03

The variables in brackets are replaced by grabber before the command is run. Curl then makes an http post request to the API of moebooru where it uploads the image along with all tags. I have Grabber set to download all images to /tmp/ which in linux is just RAM (so I don't have duplicates of every photo) the downside to this is you can't check for existing images after a reboot.

Bionus commented 8 years ago

Sorry for #577, I totally missed it.

The only possible cause for the Error while initializing commands is failing to open the connection to the database with the credentials provided in Grabber's settings. Either they are incorrect, or the MySQL server is not accessible (if it's a vanilla WampServer installation, it should be).

with the exception of this line in config.php: $mysql_user = "root"; It is not mentioned in the original manual, though without this change Gelbooru can't create new database or access an existing one

It used to be in the default config file, I'll update the wiki accordingly.

But from the fact you created issue #601, it seems you went with Flat's suggestion and started using moebooru. As it seems very easy to setup (more than Gelbooru), I'll add a wiki page for it too.

Shir01 commented 8 years ago

@Flat Again thanks for the idea and clarification, I wasn't aware of some Grabber variables, before you pointed them out. I think I will stick with the method that you provided above, though at the moment it doesn't work on Windows( #601 )

@Bionus

The only possible cause for the Error while initializing commands is failing to open the connection to the database with the credentials provided in Grabber's settings. Either they are incorrect, or the MySQL server is not accessible (if it's a vanilla WampServer installation, it should be).

I verified credentials, and it seems that they are correct just as MySQL is accessible.(screenshots below) Could you check the setup from wiki on your PC on Windows? 2016-08-29_234313 2016-08-29_234412 2016-08-29_234437

It used to be in the default config file, I'll update the wiki accordingly.

There are more lines that I corrected in order to make gelbooru work as it should, but I forgot to write all of them here. Sorry.

$site_url = "http://localhost/gelbooru/"; $thumbnail_url = "http://localhost/gelbooru/thumbnails/";

instead of

$site_url = "http://localhost/gelbooru"; $thumbnail_url = "http://gelbooru.com/thumbnails/";

Without this correction you'll get "The requested URL /gelbooruindex.php was not found on this server" error.

But from the fact you created issue #601, it seems you went with Flat's suggestion and started using moebooru. As it seems very easy to setup (more than Gelbooru), I'll add a wiki page for it too.

Actually, it's the opposite, it is much easier to deploy Gelbooru than Moebooru, at least for me. The main reason is Ruby and the way it works on Windows. I encountered numerous errors during Moebooru installation. "Bundle install" failed due to SSL error so I had to download appropriate SSL cert file and add it to environment variables, ExecJS returned weird errors so I had to install Node.js in order to change the runtime that ExecJS uses, "bundle exec rake db:create" and several other commands failed so I had to edit "Gemfile" and cherry-pick suitable version of Ruby, repeating "uninstall->install->check if everything works" cycle several times. Eventually, I got fed up with Ruby and installed Moebooru port to PHP called Myimouto, and it works like a charm. Appropriate cURL command that is needed to upload images to Myimouto can be found in #601 .

Bionus commented 8 years ago

I verified credentials, and it seems that they are correct just as MySQL is accessible.(screenshots below) Could you check the setup from wiki on your PC on Windows?

As I can see in your screenshots, it seems you added superflous quotes in your settings. Instead of "localhost", use only localhost, same goes for other fields. Double quotes are not supposed to be put in the settings (same goes for your empty "" start command that should be totally empty).

Remove these quotes and it should work.

There are more lines that I corrected in order to make gelbooru work as it should, but I forgot to write all of them here. Sorry.

No problem, I'll update the wiki and try to set a Gelbooru up on my computer from scratch soon.

Actually, it's the opposite, it is much easier to deploy Gelbooru than Moebooru, at least for me. The main reason is Ruby and the way it works on Windows.

Indeed, if it's Ruby it's much harder on Windows than Linux.

Eventually, I got fed up with Ruby and installed Moebooru port to PHP called Myimouto, and it works like a charm. Appropriate cURL command that is needed to upload images to Myimouto can be found in #601 .

In that case I'll add a MyImouto tutorial instead, if Gelbooru is being too old. As for #601, it'll be fixed in the next 4.7.0 update I'm working on now. It should be released soon (supposedly by the end of the week).

Shir01 commented 8 years ago

@Bionus

As I can see in your screenshots, it seems you added superflous quotes in your settings. Instead of "localhost", use only localhost, same goes for other fields. Double quotes are not supposed to be put in the settings (same goes for your empty "" start command that should be totally empty).

Sorry I screwed up so badly. :pensive: And I seriously thought that quotation marks are necessary. Again I'm really sorry for wasting your time.

In that case I'll add a MyImouto tutorial instead, if Gelbooru is being too old. As for #601, it'll be fixed in the next 4.7.0 update I'm working on now. It should be released soon (supposedly by the end of the week).

That is great! Thanks a lot.

ghost commented 8 years ago

Ah, I just realized this was for Windows. I'm sorry, if I had realized that, I could have confirmed that the SQL definitely works directly. Now on Mac, I haven't gotten it to work properly, but I also haven't tried recently. That's why when I answered above, I said I execute the SQL manually. Anyway, glad to see you got your problem solved.

Bionus commented 8 years ago

I added the MyImouto wiki page and updated the Gelbooru page. Note that this new page uses some new features (4.7.0) so you can't use the command written there yet.