mikf / gallery-dl

Command-line program to download image galleries and collections from several image hosting sites
GNU General Public License v2.0
11.78k stars 966 forks source link

[Bug] Unable to download certain pages/folders on Aryion #1085

Closed ghost closed 4 years ago

ghost commented 4 years ago

When I try to download from Aryion, most pages work fine but for some reason this page gives an error

gallery-dl --write-metadata https://aryion.com/g4/view/643221 [aryion][warning] Unable to fetch post 643221 ('401 LOGIN REQUIRED')

Only found it with this in particular, testing it with the usual user format, so here in particular https://aryion.com/g4/gallery/SpottedSqueak, it doesn't pop up with any errors but it still doesn't download anything.

It does mention a log in token but I haven't found how to get that for Aryion, i recall doing that for Furaffinity but no idea where to look for Aryion specifically, and putting in the pure login/password didn't work at all.

mikf commented 4 years ago
$ gallery-dl -u "USERNAME" -p "PASSWORD" "https://aryion.com/g4/view/643221"
/tmp/aryion/spottedsqueak/Vore/643221 Squirrelly Recording Process (Jit).png

$ gallery-dl -u "USERNAME" -p "PASSWORD" https://aryion.com/g4/gallery/SpottedSqueak
/tmp/aryion/spottedsqueak/Animation/574269 Bunny Digestion (Forest_Peter).gif
/tmp/aryion/spottedsqueak/Animation/539984 [COM][Animation] Leo Gulp.gif
^C
KeyboardInterrupt

Login with username & password for aryion was added in 0e941553 (v1.14.5), and there is also a section about Cookie usage in the README.

ghost commented 4 years ago
$ gallery-dl -u "USERNAME" -p "PASSWORD" "https://aryion.com/g4/view/643221"
/tmp/aryion/spottedsqueak/Vore/643221 Squirrelly Recording Process (Jit).png

$ gallery-dl -u "USERNAME" -p "PASSWORD" https://aryion.com/g4/gallery/SpottedSqueak
/tmp/aryion/spottedsqueak/Animation/574269 Bunny Digestion (Forest_Peter).gif
/tmp/aryion/spottedsqueak/Animation/539984 [COM][Animation] Leo Gulp.gif
^C
KeyboardInterrupt

Login with username & password for aryion was added in 0e94155 (v1.14.5), and there is also a section about Cookie usage in the README.

Any specific string I should look for? I recall with Furaffinity that required putting the cookie values into the config, or at least that was an option, but I'm not sure what strings i should look for when I check Aryion, since checking via inspector tools shows strings like "phpbb3_rl7a3_k" and so on, unless just putting the actual username and password as is via -u and -p is how it's done for this one.

mikf commented 4 years ago

The relevant cookie for aryion.com is phpbb3_rl7a3_sid, but all cookies for this site expire after 28 days and you'd need to manually update them after that. You are better off adding a username & password to your config file:

        "aryion":
        {
            "username": "...",
            "password": "..."
        },
ghost commented 4 years ago

The relevant cookie for aryion.com is phpbb3_rl7a3_sid, but all cookies for this site expire after 28 days and you'd need to manually update them after that. You are better off adding a username & password to your config file:

        "aryion":
        {
            "username": "...",
            "password": "..."
        },

Any case sensitivity in there? I put it in just like that but when I put in the user and password I get a parse error, but only after putting in the user and password itself, if I leave it as NULL then it won't throw this error up.

[config][warning] Could not parse '/home/chao/.config/gallery-dl/config.json': Expecting value: line 165 column 19 (char 3402)

mikf commented 4 years ago

You should only need to escape " and \ with a backslash (\", \\), but you'd get a different error message if that were the problem. Expecting value sounds like there is a key without a value after it, e.g. "username": ,.

It's probably best you use an (online) JSON validator and try to find the error that way.

And just for testing purposes, you could try using only the following 4 lines as config file:

{
    "username": "...",
    "password": "..."
}
ghost commented 4 years ago

You should only need to escape " and \ with a backslash (\", \\), but you'd get a different error message if that were the problem. Expecting value sounds like there is a key without a value after it, e.g. "username": ,.

It's probably best you use an (online) JSON validator and try to find the error that way.

And just for testing purposes, you could try using only the following 4 lines as config file:

{
    "username": "...",
    "password": "..."
}

Tested in a JSON validator now, turns out the username/password both need quotes within them

"username": "insert username", "password": "insert password"

To name an example, when I did that, the JSON was listed as valid and gallery-dl picked it up, so looks like it's fixed now.