mikf / gallery-dl

Command-line program to download image galleries and collections from several image hosting sites
GNU General Public License v2.0
12.06k stars 981 forks source link

Problem in Deviantart #3928

Open CashOver opened 1 year ago

CashOver commented 1 year ago

I don't know why this problem is happening (API responded with 429 Too Many Requests) I would like to know how I could fix it

rautamiekka commented 1 year ago

Most likely duplicate of #3924

Simply: use the username+password combination (just in case), use the OAuth refresh token, and ensure gdl is allowed to get the cookies from your default web browser and the cookies update option ain't disabled (for "deviantart" and "stash" extractors). With all these 3, you should be good for a long time.

left1000 commented 1 year ago

Most likely duplicate of #3924

Simply: use the username+password combination (just in case), use the OAuth refresh token, and ensure gdl is allowed to get the cookies from your default web browser and the cookies update option ain't disabled (for "deviantart" and "stash" extractors). With all these 3, you should be good for a long time.

I'm using password/cookies/clientsecret but I just realized that my extractor has no setting for cookies-update... I just periodically update the cookies file I am using myself. But if there's a syntax to tell deviantart's extractor to autoupdate my cookies I'd be up for turning that on, but it wasn't in the .conf template I used, so I didn't include it.

CashOver commented 1 year ago

It's still giving the same error

mikf commented 1 year ago

It's still giving the same error

And you still haven't posted more than "it doesn't work" as an error description. We can't help you if you don't post more information like your gallery-dl version and your config settings.


I just realized that my extractor has no setting for cookies-update

cookies-update is enabled by default.

CashOver commented 1 year ago

hi, i would like to say that all the configuration extractors were updated ex:

        "base-directory": "./gallery-dl/",
        "parent-directory": false,
        "postprocessors": null,
        "archive": null,
        "cookies": null,
        "cookies-update": true,
        "proxy": null,
        "skip": true,

        "user-agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:109.0) Gecko/20100101 Firefox/112.0",
        "retries": 4,
        "timeout": 30.0,
        "verify": true,
        "fallback": true,

        "sleep": 0,
        "sleep-request": 0,
        "sleep-extractor": 0,

        "path-restrict": "auto",
        "path-replace": "_",
        "path-remove": "\\u0000-\\u001f\\u007f",
        "path-strip": "auto",
        "path-extended": true,

But all deviantart activation fram enabled ex:

            "client-id": "12345",
            "client-secret": "...",
        "refresh-token": "...",
            "auto-watch": false,
            "auto-unwatch": false,
            "comments": false,
            "extra": false,
            "flat": true,
            "folders": false,
            "group": true,
            "include": "gallery",
            "journals": "html",
            "mature": true,
            "metadata": false,
            "original": true,
            "wait-min": 0

But there is still a download error in both the images and the paid link

mikf commented 1 year ago

I guess I should have said "verbose log of the error" (gallery-dl --verbose URL), since that would have included the version and whether it actually loaded your config file or not.

You gallery-dl version is really important here, since there have been changes to the deviantart code in this regard in the latest release (v1.25.2). Make sure you are using that version and try setting deviantart.public to false.

https://github.com/mikf/gallery-dl/issues/3924 might also be related.

CashOver commented 1 year ago

This is how the command ex: "client-id": "12345", "client-secret": "...", "refresh-token": "...", "auto-watch": false, "auto-unwatch": false, "comments": false, "extra": false, "flat": true, "folders": false, "group": true, "include": "gallery", "journals": "html", "mature": true, "metadata": false, "original": true, "public": false, "wait-min": 0

because the situation only got worse, the error starts right at the beginning when downloading the content until when it is added in the command "https://github.com/mikf/gallery-dl/blob/master/docs/configuration.rst#extractordeviantartpagination" still continues giving error

CashOver commented 1 year ago

thanks for fixing this recent version