Jules-WinnfieldX / CyberDropDownloader

Bulk Gallery Downloader for Cyberdrop.me and Other Sites
GNU General Public License v3.0
1.6k stars 185 forks source link

[BUG] Bunkr album images without preview #818

Closed glandalfo closed 6 months ago

glandalfo commented 6 months ago

Describe the bug Bunkr album images which do not have image previews give a 404 error when being downloaded, despite being able to be downloaded manually from the website.

To Help Reproduce These two album produce this issue: https://bunkr.si/a/hZuPRSQZ https://bunkr.si/a/Cn6gcdwA

Setup Information

Downloader.log file

INFO     : 2024-02-16 12:08:39,111 : utilities.py:95 : Starting Async Processes...
DEBUG    : 2024-02-16 12:08:39,111 : utilities.py:95 : Starting Cyberdrop-DL Process for CLI-Arg Specified Config
DEBUG    : 2024-02-16 12:08:39,111 : utilities.py:95 : Running version 5.1.68
DEBUG    : 2024-02-16 12:08:39,111 : utilities.py:95 : Using Config: CLI-Arg Specified
DEBUG    : 2024-02-16 12:08:39,111 : utilities.py:95 : Using Config File: /mnt/shares/media/Tools/.config/cyberdrop-dl/AppData/Configs/roaming/settings.yaml
DEBUG    : 2024-02-16 12:08:39,111 : utilities.py:95 : Using Input File: .cdl/URLs.txt
DEBUG    : 2024-02-16 12:08:39,111 : utilities.py:95 : Using Download Folder: .cdl/downloads
DEBUG    : 2024-02-16 12:08:39,112 : utilities.py:95 : Using History File: /mnt/shares/media/Tools/.config/cyberdrop-dl/AppData/Cache/cyberdrop.db
DEBUG    : 2024-02-16 12:08:39,112 : utilities.py:95 : Using Authentication: 
{
    "DDOS-Guard": {
        "Bunkrr Provided": true,
        "Coomer Provided": false,
        "Kemono Provided": false
    },
    "Forums Credentials": {
        "celebforum Credentials Provided": false,
        "f95zone Credentials Provided": false,
        "leakedmodels Credentials Provided": false,
        "nudostar Credentials Provided": true,
        "simpcity Credentials Provided": true,
        "socialmediagirls Credentials Provided": true,
        "xbunker Credentials Provided": true
    },
    "Forums XF Cookies": {
        "celebforum XF Cookie Provided": false,
        "f95zone XF Cookie Provided": false,
        "leakedmodels XF Cookie Provided": false,
        "nudostar XF Cookie Provided": false,
        "simpcity XF Cookie Provided": false,
        "socialmediagirls XF Cookie Provided": false,
        "xbunker XF Cookie Provided": false
    },
    "GoFile Provided": true,
    "Imgur Provided": true,
    "JDownloader Provided": false,
    "PixelDrain Provided": true,
    "Reddit Provided": true
}
DEBUG    : 2024-02-16 12:08:39,112 : utilities.py:95 : Using Settings: 
{
    "Download_Options": {
        "block_download_sub_folders": false,
        "disable_download_attempt_limit": false,
        "disable_file_timestamps": false,
        "include_album_id_in_folder_name": false,
        "include_thread_id_in_folder_name": false,
        "remove_domains_from_folder_names": false,
        "remove_generated_id_from_filenames": false,
        "scrape_single_forum_post": false,
        "separate_posts": false,
        "skip_download_mark_completed": false
    },
    "File_Size_Limits": {
        "maximum_image_size": 0,
        "maximum_other_size": 0,
        "maximum_video_size": 0,
        "minimum_image_size": 0,
        "minimum_other_size": 0,
        "minimum_video_size": 0
    },
    "Files": {
        "download_folder": ".cdl/downloads",
        "input_file": ".cdl/URLs.txt"
    },
    "Ignore_Options": {
        "exclude_audio": false,
        "exclude_images": false,
        "exclude_other": false,
        "exclude_videos": false,
        "ignore_coomer_ads": false,
        "only_hosts": [],
        "skip_hosts": []
    },
    "Logs": {
        "download_error_urls_filename": "Download_Error_URLs.csv",
        "last_forum_post_filename": "Last_Scraped_Forum_Posts.txt",
        "log_folder": ".cdl/logs",
        "main_log_filename": "downloader.log",
        "scrape_error_urls_filename": "Scrape_Error_URLs.csv",
        "unsupported_urls_filename": "Unsupported_URLs.txt"
    },
    "Runtime_Options": {
        "delete_partial_files": false,
        "ignore_history": false,
        "log_level": 10,
        "send_unsupported_to_jdownloader": false,
        "skip_check_for_empty_folders": false,
        "skip_check_for_partial_files": false
    },
    "Sorting": {
        "sort_downloads": false,
        "sort_folder": ".cdl/downloads/Cyberdrop-DL Sorted Downloads",
        "sort_incremementer_format": " ({i})",
        "sorted_audio": "{sort_dir}/{base_dir}/Audio/{filename}{ext}",
        "sorted_image": "{sort_dir}/{base_dir}/Images/{filename}{ext}",
        "sorted_other": "{sort_dir}/{base_dir}/Other/{filename}{ext}",
        "sorted_video": "{sort_dir}/{base_dir}/Videos/{filename}{ext}"
    }
}
DEBUG    : 2024-02-16 12:08:39,112 : utilities.py:95 : Using Global Settings: 
{
    "General": {
        "allow_insecure_connections": false,
        "max_file_name_length": 95,
        "max_folder_name_length": 60,
        "proxy": "",
        "required_free_space": 5,
        "user_agent": "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/120.0.0.0 Safari/537.36"
    },
    "Rate_Limiting_Options": {
        "connection_timeout": 15,
        "download_attempts": 10,
        "download_delay": 0,
        "max_simultaneous_downloads": 15,
        "max_simultaneous_downloads_per_domain": 5,
        "rate_limit": 50,
        "read_timeout": 300
    }
}
INFO     : 2024-02-16 12:08:39,163 : utilities.py:95 : Starting UI...
INFO     : 2024-02-16 12:08:39,256 : utilities.py:95 : Scrape Starting: https://bunkr.si/a/hZuPRSQZ
DEBUG    : 2024-02-16 12:08:39,743 : utilities.py:95 : Skipping https://fries.bunkr.ru/0gtnzv3q3tc3b482xtrud_source-uixFpOxZ.mp4?download=true as it has already been downloaded
DEBUG    : 2024-02-16 12:08:39,942 : utilities.py:95 : Skipping https://fries.bunkr.ru/0gt1xh0z7po889lc7a3g0_source-yg7zCGqx.mp4?download=true as it has already been downloaded
DEBUG    : 2024-02-16 12:08:40,127 : utilities.py:95 : Skipping https://fries.bunkr.ru/0guj6zd29eejiz5hzg6z9_source-Nx91eMZv.mp4?download=true as it has already been downloaded
DEBUG    : 2024-02-16 12:08:40,306 : utilities.py:95 : Skipping https://fries.bunkr.ru/0grkel3jdxh2egd1y0fl7_source-v4QpvtRI.mp4?download=true as it has already been downloaded
DEBUG    : 2024-02-16 12:08:40,519 : utilities.py:95 : Skipping https://fries.bunkr.ru/0gsei8a2r7hh1mv7k5n13_source-EW59yMqf.mp4?download=true as it has already been downloaded
DEBUG    : 2024-02-16 12:08:40,748 : utilities.py:95 : Skipping https://fries.bunkr.ru/0gsq5qm582ley0pvdjael_source-V0QNUNxp.mp4?download=true as it has already been downloaded
DEBUG    : 2024-02-16 12:08:40,954 : utilities.py:95 : Skipping https://fries.bunkr.ru/0gtnzrwhv79albzm1i3g2_source-6ArVGT25.mp4?download=true as it has already been downloaded
DEBUG    : 2024-02-16 12:08:41,140 : utilities.py:95 : Skipping https://fries.bunkr.ru/0gtmsszper9kz9vrhj6eu_source-BsQhJFl1.mp4?download=true as it has already been downloaded
DEBUG    : 2024-02-16 12:08:41,330 : utilities.py:95 : Skipping https://fries.bunkr.ru/0gu8ma7g354j25g2gdtqa_source-wRA8r41s.mp4?download=true as it has already been downloaded
DEBUG    : 2024-02-16 12:08:41,556 : utilities.py:95 : Skipping https://fries.bunkr.ru/0gstwaua8a8ihgwvobdch_source-x7bpTEBP.mp4?download=true as it has already been downloaded
DEBUG    : 2024-02-16 12:08:41,742 : utilities.py:95 : Skipping https://fries.bunkr.ru/0gt2zu3p13sg63z3q38em_source-4NwuQCDZ.mp4?download=true as it has already been downloaded
DEBUG    : 2024-02-16 12:08:41,925 : utilities.py:95 : Skipping https://fries.bunkr.ru/0gvlayef7r6szmq8o4t9p_source-lsMbO9j4.mp4?download=true as it has already been downloaded
DEBUG    : 2024-02-16 12:08:42,131 : utilities.py:95 : Skipping https://fries.bunkr.ru/0gumf6yhsng22wu4wbnt8_source-alycb1oG.mp4?download=true as it has already been downloaded
DEBUG    : 2024-02-16 12:08:42,344 : utilities.py:95 : Skipping https://fries.bunkr.ru/0gwcvv517ez7d3uh6adp2_source-5MNFLipB.mp4?download=true as it has already been downloaded
DEBUG    : 2024-02-16 12:08:42,585 : utilities.py:95 : Skipping https://fries.bunkr.ru/0gtmsst0jkn2159pj9zej_source-6KCSZLu3.mp4?download=true as it has already been downloaded
DEBUG    : 2024-02-16 12:08:42,786 : utilities.py:95 : Skipping https://fries.bunkr.ru/0gsevu7x13tr56lyhas9o_source-UYGCMypp.mp4?download=true as it has already been downloaded
DEBUG    : 2024-02-16 12:08:43,006 : utilities.py:95 : Skipping https://fries.bunkr.ru/0grlhf7rxf9bow243k1iw_source-iYgxoAZK.mp4?download=true as it has already been downloaded
DEBUG    : 2024-02-16 12:08:43,223 : utilities.py:95 : Skipping https://fries.bunkr.ru/0gunnoc5gip9u8j46ra96_source-OJBMKrd7.mp4?download=true as it has already been downloaded
DEBUG    : 2024-02-16 12:08:43,425 : utilities.py:95 : Skipping https://fries.bunkr.ru/0gvxr6uss0250ekt208br_source-ylJO8Qjy.mp4?download=true as it has already been downloaded
DEBUG    : 2024-02-16 12:08:43,625 : utilities.py:95 : Skipping https://fries.bunkr.ru/0gw9j3ru07bjtvujq72lc_source-3SkevZJP.mp4?download=true as it has already been downloaded
DEBUG    : 2024-02-16 12:08:43,807 : utilities.py:95 : Skipping https://fries.bunkr.ru/0gpl7a58n0phrjdmkngq2_source-ossBWTbC.mp4?download=true as it has already been downloaded
DEBUG    : 2024-02-16 12:08:43,987 : utilities.py:95 : Skipping https://fries.bunkr.ru/0grqfzup6m3f5bjekrx4u_source-OCoEZ0jg.mp4?download=true as it has already been downloaded
DEBUG    : 2024-02-16 12:08:44,187 : utilities.py:95 : Skipping https://fries.bunkr.ru/0grzvx0wy8f0yomhd1v3o_source-Loq0MXFJ.mp4?download=true as it has already been downloaded
DEBUG    : 2024-02-16 12:08:44,382 : utilities.py:95 : Skipping https://fries.bunkr.ru/0gthyayy4rj7uppw4i81g_source-AHsk8YO7.mp4?download=true as it has already been downloaded
DEBUG    : 2024-02-16 12:08:44,570 : utilities.py:95 : Skipping https://fries.bunkr.ru/0gtmssfijvaqyuauqxqnb_source-JEg75AfH.mp4?download=true as it has already been downloaded
DEBUG    : 2024-02-16 12:08:44,690 : utilities.py:95 : Skipping https://fries.bunkr.ru/0gtmssdn57qf1g5zghbyn_source-ffN6ND9K.mp4?download=true as it has already been downloaded
DEBUG    : 2024-02-16 12:08:44,868 : utilities.py:95 : Skipping https://fries.bunkr.ru/0gu1jwpkf4audej2g94bx_source-9rS6TlhR.mp4?download=true as it has already been downloaded
DEBUG    : 2024-02-16 12:08:45,079 : utilities.py:95 : Skipping https://fries.bunkr.ru/0gu9vqx56vcd5rvx728d3_source-MudExXcJ.mp4?download=true as it has already been downloaded
DEBUG    : 2024-02-16 12:08:45,276 : utilities.py:95 : Skipping https://fries.bunkr.ru/0gvnpzdlukol5bagiexig_source-QsS6XfdL.mp4?download=true as it has already been downloaded
DEBUG    : 2024-02-16 12:08:45,487 : utilities.py:95 : Skipping https://fries.bunkr.ru/0guebh31vsnqsn1xi6t66_source-YqADF7Yd.mp4?download=true as it has already been downloaded
DEBUG    : 2024-02-16 12:08:45,682 : utilities.py:95 : Skipping https://fries.bunkr.ru/0gv1mky7vfg9onusjupdl_source-7J6VZRaV.mp4?download=true as it has already been downloaded
DEBUG    : 2024-02-16 12:08:45,862 : utilities.py:95 : Skipping https://fries.bunkr.ru/0guj6xd8n3z4d1qsyre3j_source-AiHhtgj4.mp4?download=true as it has already been downloaded
INFO     : 2024-02-16 12:08:46,002 : utilities.py:95 : Download Starting: https://bnkr.b-cdn.net/no-image.jpg?download=true
ERROR    : 2024-02-16 12:08:46,298 : utilities.py:95 : Download failed: https://bnkr.b-cdn.net/no-image.jpg?download=true with status 404 and message HTTP status code 404: Not Found
INFO     : 2024-02-16 12:08:46,301 : utilities.py:95 : Download Finished: https://bnkr.b-cdn.net/no-image.jpg?download=true
DEBUG    : 2024-02-16 12:08:49,596 : utilities.py:95 : Skipping https://fries.bunkr.ru/0gw2nlpmifkg9ozsvr8p7_source-HNgjrvZL.mp4?download=true as it has already been downloaded
INFO     : 2024-02-16 12:08:59,547 : utilities.py:95 : Scrape Finished: https://bunkr.sk/a/hZuPRSQZ
INFO     : 2024-02-16 12:08:59,556 : utilities.py:95 : Running Post-Download Processes...
INFO     : 2024-02-16 12:08:59,556 : utilities.py:100 : Checking for partial downloads...
INFO     : 2024-02-16 12:08:59,560 : utilities.py:100 : Checking for empty folders...
INFO     : 2024-02-16 12:08:59,562 : utilities.py:95 : Printing Stats...
INFO     : 2024-02-16 12:08:59,562 : utilities.py:100 : 
Download Stats:
INFO     : 2024-02-16 12:08:59,562 : utilities.py:100 : Downloaded 0 files
INFO     : 2024-02-16 12:08:59,562 : utilities.py:100 : Previously Downloaded 33 files
INFO     : 2024-02-16 12:08:59,563 : utilities.py:100 : Skipped By Config 0 files
INFO     : 2024-02-16 12:08:59,563 : utilities.py:100 : Failed 1 files
INFO     : 2024-02-16 12:08:59,563 : utilities.py:100 : 
Scrape Failures:
INFO     : 2024-02-16 12:08:59,563 : utilities.py:100 : 
Download Failures:
INFO     : 2024-02-16 12:08:59,564 : utilities.py:100 : Download Failures (404 HTTP Status): 1
INFO     : 2024-02-16 12:08:59,564 : utilities.py:95 : Checking for Program End...
INFO     : 2024-02-16 12:08:59,564 : utilities.py:95 : Checking for Updates...
INFO     : 2024-02-16 12:08:59,828 : utilities.py:95 : Closing Program...
INFO     : 2024-02-16 12:08:59,831 : utilities.py:100 : 
Finished downloading. Enjoy :)
Jules-WinnfieldX commented 6 months ago

5.1.69 fixes this