mikf / gallery-dl

Command-line program to download image galleries and collections from several image hosting sites
GNU General Public License v2.0
11.93k stars 975 forks source link

'403 forbidden' on Kemono when the link is working #2683

Closed a84r7a3rga76fg closed 1 year ago

a84r7a3rga76fg commented 2 years ago

Example: https://data5.kemono.party/data/74/e0/74e07991e58656be6876c1d437464ebf8f1511e70c22baef6e4399c38f95e69e.jpg

mikf commented 2 years ago

Using your browser's cookies seems to work:

$ gallery-dl https://data5.kemono.party/data/74/e0/74e07991e58656be6876c1d437464ebf8f1511e70c22baef6e4399c38f95e69e.jpg
[downloader.http][warning] '403 Forbidden' for 'https://data5.kemono.party/data/74/e0/74e07991e58656be6876c1d437464ebf8f1511e70c22baef6e4399c38f95e69e.jpg'
[download][error] Failed to download data5.kemono.party_data_74_e0_74e07991e58656be6876c1d437464ebf8f1511e70c22baef6e4399c38f95e69e.jpg

$ gallery-dl --cookies cookies-kemono-party.txt  https://data5.kemono.party/data/74/e0/74e07991e58656be6876c1d437464ebf8f1511e70c22baef6e4399c38f95e69e.jpg
/tmp/directlink/data5.kemono.party_data…4ebf8f1511e70c22baef6e4399c38f95e69e.jpg
left1000 commented 2 years ago

I am getting the same error only for coomer.party (kemono.party works fine for me) and last week both worked.

edit: same solution works, using my browser's cookies file, although this wasn't required last week it is now.

left1000 commented 2 years ago

Trying to add this solution to my conf file fails:

[config][warning] Could not parse 'C:\Users\NAME\gallery-dl.conf': Invalid \escape: line 35 column 27 (char 1025)

            "cookies": "D:\gallery-dl\coomer.party_cookies.txt",

that is the invalid line.

I think gallery-dl is expecting

              "cookies": {
                "__ddg1": "",
        "__ddg2": ""    

but that no longer works, so either my syntax is wrong or there needs to be an update to accept the correct entry?

Silent-Soldier commented 2 years ago

You need to escape backslashes, or alternatively use forward slashes in their place on Windows, as below.

"cookies": "D:\\gallery-dl\\coomer.party_cookies.txt", or "cookies": "D:/gallery-dl/coomer.party_cookies.txt",

You can read more about this in the Configuration Doc.

left1000 commented 2 years ago

Thanks, I LITERALLY had an example of another file right next to this line with the slashes going the correct way and it just zoomed over my head.

a84r7a3rga76fg commented 2 years ago

Kemono said cookies are no longer needed but it turns out they lied. I don't remember how my cookies setup looked like in the config, can someone tell me if this is everything? Also, what's the difference between a text file for cookies and putting cookies in the config file?

            "cookies": {
                "__ddg1": "",
                "__ddg2": "",
                "__ddg5": "",
                "__ddgid": "",
                "__ddgmark": "",
                "_pk_id.1.5bc1": ".",
                "_pk_ses.1.5bc1": ""
            },

edit: I'm only seeing ddg1, pk_id.1.5bc1 and pk_ses.1.5bc1 on Firefox, does anyone know how to retrieve ddg2, ddg5, ddgid and ddgmark?

left1000 commented 2 years ago

My kemono cookies are only

            "__ddg1": "",
            "__ddg2": "",

{With the values not-empty that is}

a84r7a3rga76fg commented 2 years ago

Seems like ddg2 is needed because I'm still getting 403 forbidden with only ddg1, how did you obtain ddg2?

mikf commented 2 years ago

From a kemono admin (https://chan.kemono.party/kemono/res/21580.html#q21806):

wget 1.20.3 works, curl 7.66.0 works Welp, ddg is sperging out on d5. Will probably be fixed at some point today. Otherwise just use the 'curl/7.66.0' useragent.

... and that actually does work (for me), even without cookies:

$ gallery-dl -o user-agent="curl/7.66.0" https://data5.kemono.party/data/74/e0/74e07991e58656be6876c1d437464ebf8f1511e70c22baef6e4399c38f95e69e.jpg
/tmp/directlink/data5.kemono.party_data…4ebf8f1511e70c22baef6e4399c38f95e69e.jpg

(at the moment, using the same cookies as in https://github.com/mikf/gallery-dl/issues/2683#issuecomment-1156272238 gives a 403 error)

Luke-L commented 2 years ago

still getting 403: Forbidden, even with the user agent tweak and no cookies. any idea for a fix?

B:\Github\gallery-dl>gallery-dl -o user-agent="curl/7.66.0" "https://coomer.party/onlyfans/user/azalyastar"

[downloader.http][warning] '403 Forbidden' for 'https://coomer.party/data/98/23/98236e1bf9605f07d0f3976da4943b1f98bed7fc5045c26aab5eadb69f495060.jpg'
[download][error] Failed to download 332643584_Juicccccy_01_006a33e2-8f68-402b-9f74-838277fc0fab.jpg
[downloader.http][warning] '403 Forbidden' for 'https://coomer.party/data/2c/29/2c290dfe40995c92c52945215a869943cb5837728f10f7158fe03d698b9f838a.jpg'
...
[downloader.http][warning] '403 Forbidden' for 'https://coomer.party/data/a1/f2/a1f29779b203865613ac871656a6a770fa408f223b0ae0e78b4476842e93fc14.jpg'
[download][error] Failed to download 178824441_Ready to have my tight holes filled_01_0c6a314f-b763-4f0c-acc3-eee5587d8dc7.jpg
[downloader.http][warning] '403 Forbidden' for 'https://coomer.party/data/1a/ef/1aefc236c901715d6e3a4803dfedb92d8726566d1ad89d4e343d0642e98a4587.jpg'
[download][error] Failed to download 178824441_Ready to have my tight holes filled_02_f77ae8ee-a1d1-462a-878c-1f8cea4fe61c.jpg
[coomerparty][error] HttpError: '403 Forbidden' for 'https://coomer.party/api/onlyfans/user/azalyastar'
gazebo-guy commented 2 years ago

I'm experiencing the same issue as Luke-L, I've tried messing with the cookies and the user-agent to no avail.

Edit: I figured out my issue. I was connected to my VPN, once I disconnected from my VPN, it worked just fine, That should have been the first thing I tried.