mikf / gallery-dl

Command-line program to download image galleries and collections from several image hosting sites
GNU General Public License v2.0
11.7k stars 953 forks source link

[DeviantArt] Shortened URLs no longer working #4316

Closed Michyrr closed 1 year ago

Michyrr commented 1 year ago

When I try to use a deviantart.com/view/, deviantart.com/deviation/, or fav.me/ link, I just get the error: [deviantart][error] NotFoundError: Requested deviation could not be found. Only using the full URL works.

rautamiekka commented 1 year ago

Provide the command used, the full output log when using --verbose, and the config file, from all of which you censored your usernames/passwords/ID's of course.

Michyrr commented 1 year ago

Note: I renamed the executable to 'gdl.exe' for easier typing.

Output log:

Microsoft Windows [Version 6.1.7601]
Copyright (c) 2009 Microsoft Corporation.  All rights reserved.

C:\Users\RTE>gdl --version
1.25.8

C:\Users\RTE>gdl --verbose deviantart.com/view/972227588
[gallery-dl][debug] Version 1.25.8 - Executable
[gallery-dl][debug] Python 3.8.10 - Windows-7-6.1.7601-SP1
[gallery-dl][debug] requests 2.31.0 - urllib3 1.26.16
[gallery-dl][debug] Configuration Files ['%USERPROFILE%\\gallery-dl.conf']
[gallery-dl][debug] Starting DownloadJob for 'deviantart.com/view/972227588'
[deviantart][debug] Using DeviantartDeviationExtractor for 'deviantart.com/view/972227588'
[deviantart][debug] Using custom API credentials (client-id [REDACTED])
[urllib3.connectionpool][debug] Starting new HTTPS connection (1): www.deviantart.com:443
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /u/art/972227588 HTTP/1.1" 404 None
[deviantart][error] NotFoundError: Requested deviation could not be found

C:\Users\RTE>gdl --verbose deviantart.com/deviation/972227588
[gallery-dl][debug] Version 1.25.8 - Executable
[gallery-dl][debug] Python 3.8.10 - Windows-7-6.1.7601-SP1
[gallery-dl][debug] requests 2.31.0 - urllib3 1.26.16
[gallery-dl][debug] Configuration Files ['%USERPROFILE%\\gallery-dl.conf']
[gallery-dl][debug] Starting DownloadJob for 'deviantart.com/deviation/972227588'
[deviantart][debug] Using DeviantartDeviationExtractor for 'deviantart.com/deviation/972227588'
[deviantart][debug] Using custom API credentials (client-id [REDACTED])
[urllib3.connectionpool][debug] Starting new HTTPS connection (1): www.deviantart.com:443
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /u/art/972227588 HTTP/1.1" 404 None
[deviantart][error] NotFoundError: Requested deviation could not be found

C:\Users\RTE>gdl --verbose fav.me/dg2u7lw
[gallery-dl][debug] Version 1.25.8 - Executable
[gallery-dl][debug] Python 3.8.10 - Windows-7-6.1.7601-SP1
[gallery-dl][debug] requests 2.31.0 - urllib3 1.26.16
[gallery-dl][debug] Configuration Files ['%USERPROFILE%\\gallery-dl.conf']
[gallery-dl][debug] Starting DownloadJob for 'fav.me/dg2u7lw'
[deviantart][debug] Using DeviantartDeviationExtractor for 'fav.me/dg2u7lw'
[deviantart][debug] Using custom API credentials (client-id [REDACTED])
[urllib3.connectionpool][debug] Starting new HTTPS connection (1): www.deviantart.com:443
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /u/art/972227588 HTTP/1.1" 404 None
[deviantart][error] NotFoundError: Requested deviation could not be found

C:\Users\RTE>gdl --verbose https://www.deviantart.com/ayyk92/art/Apply-Directly-to-the-Forehead-972227588
[gallery-dl][debug] Version 1.25.8 - Executable
[gallery-dl][debug] Python 3.8.10 - Windows-7-6.1.7601-SP1
[gallery-dl][debug] requests 2.31.0 - urllib3 1.26.16
[gallery-dl][debug] Configuration Files ['%USERPROFILE%\\gallery-dl.conf']
[gallery-dl][debug] Starting DownloadJob for 'https://www.deviantart.com/ayyk92/art/Apply-Directly-to-the-Forehead-972227588'
[deviantart][debug] Using DeviantartDeviationExtractor for 'https://www.deviantart.com/ayyk92/art/Apply-Directly-to-the-Forehead
-972227588'
[deviantart][debug] Using custom API credentials (client-id [REDACTED])
[deviantart][info] Requesting public access token
[urllib3.connectionpool][debug] Starting new HTTPS connection (1): www.deviantart.com:443
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "POST /oauth2/token HTTP/1.1" 200 128
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/user/profile/ayyk92 HTTP/1.1" 200 1334
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /ayyk92/art/972227588 HTTP/1.1" 200 None
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/69A2B5F8-64F0-BE06-907B-02E5090BA8B
6 HTTP/1.1" 200 1164
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/metadata?deviationids%5B0%5D=69A2B5
F8-64F0-BE06-907B-02E5090BA8B6&mature_content=true HTTP/1.1" 200 422
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/download/69A2B5F8-64F0-BE06-907B-02
E5090BA8B6?mature_content=true HTTP/1.1" 200 610
[urllib3.connectionpool][debug] Starting new HTTPS connection (1): wixmp-ed30a86b8c4ca887773594c2.wixmp.com:443
[urllib3.connectionpool][debug] https://wixmp-ed30a86b8c4ca887773594c2.wixmp.com:443 "GET /f/bd4d03a6-8214-46fd-a8b9-a04045e2747
3/dg2u7lw-507a1df6-7da9-44b0-97e8-5182a0a0dd1f.png?token=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJzdWIiOiJ1cm46YXBwOjdlMGQxODg5OD
IyNjQzNzNhNWYwZDQxNWVhMGQyNmUwIiwiaXNzIjoidXJuOmFwcDo3ZTBkMTg4OTgyMjY0MzczYTVmMGQ0MTVlYTBkMjZlMCIsImV4cCI6MTY4OTY4NzAxNSwiaWF0Ij
oxNjg5Njg2NDA1LCJqdGkiOiI2NGI2OTE4ZjA5YmE4Iiwib2JqIjpbW3sicGF0aCI6IlwvZlwvYmQ0ZDAzYTYtODIxNC00NmZkLWE4YjktYTA0MDQ1ZTI3NDczXC9kZz
J1N2x3LTUwN2ExZGY2LTdkYTktNDRiMC05N2U4LTUxODJhMGEwZGQxZi5wbmcifV1dLCJhdWQiOlsidXJuOnNlcnZpY2U6ZmlsZS5kb3dubG9hZCJdfQ.a4SiM-kRysi
rNr8peQ-8kqIXVuocwpMCRI6d98yyEZg HTTP/1.1" 200 2074561
* D:\DOA\temp\gallery-dl\deviantart\ayyk92\972227588_apply_directly_to_the_forehead_by_ayyk92-dg2u7lw.png

C:\Users\RTE>

Config file (with redactions):

{
    "extractor":
    {
        "base-directory": "D:\\[REDACTED]",
        "postprocessors": [
            {
                "name": "ugoira",
                "whitelist": ["pixiv", "danbooru"],
                "keep-files": true
            }
        ],
        "archive": null,
        "cookies": null,
        "cookies-update": false,
        "proxy": null,
        "skip": true,
        "sleep": 0,
        "path-restrict": "auto",
        "path-replace": "_",
        "path-remove": "\\u0000-\\u001f\\u007f",
        "user-agent": "Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Firefox/68.0",

        "deviantart":
        {
            "extra": true,
            "flat": true,
            "folders": false,
            "journals": "html",
            "mature": true,
            "metadata": false,
            "original": true,
            "quality": 100,
            "filename": "{index}_{filename}.{extension}",
            "client-id": "[REDACTED]",
            "client-secret": "[REDACTED]"
        },
        [[REDACTED] other extractors]
    },

    "downloader":
    {
        "filesize-min": null,
        "filesize-max": null,
        "part": true,
        "part-directory": null,

        "http":
        {
            "adjust-extensions": true,
            "mtime": true,
            "rate": null,
            "retries": 4,
            "timeout": 30.0,
            "verify": true
        },

        "ytdl":
        {
            "format": null,
            "forward-cookies": false,
            "mtime": true,
            "outtmpl": null,
            "rate": null,
            "retries": 4,
            "timeout": 30.0,
            "verify": true
        }
    },

    "output":
    {
        "mode": "auto",
        "progress": true,
        "shorten": true,
        "log": "[{name}][{levelname}] {message}",
        "logfile": null,
        "unsupportedfile": null
    },

    "netrc": false
}
rautamiekka commented 1 year ago

The output is uncensored.

Michyrr commented 1 year ago

oops. em, what do I remove?