mikf / gallery-dl

Command-line program to download image galleries and collections from several image hosting sites
GNU General Public License v2.0
11.81k stars 968 forks source link

Help capturing fanbox metadata #2578

Open MrSeyker opened 2 years ago

MrSeyker commented 2 years ago

I need to save the data from the text posts along with the files, as they contain links and passwords, but I can't capture anything.

        "postprocessors": [{
            "name": "metadata",
            "event": "post",
            "filename": "{id}_{title}.txt",
            "mode": "custom",
            "format": "{content}\n\n{tags}\n\n"
        }],

The tags are being captured, which is great, but nothing else is. I've tried "content", "description", "post". Looking over the code for the fanbox extractor, I came across "articleBody". Now this did the trick, as it saved the raw code from post description.

Problem is, that only works when I link directly to the posts, when batch downloading by using the creator url, nothing is being saved except the tags.

mikf commented 2 years ago

I've tried "content", "description", "post".

You can use -K or -j --range 1 together with any URL to get an overview over all available metadata fields. fanbox seems to call this particular field text.

articleBody is not available for all posts, I think. For example https://www.fanbox.cc/@xub/posts/1910054 does not include such a field.

MrSeyker commented 2 years ago

Checked it finally.

excerpt captures the plain text in a post, but that doesn't save the embeded ulrs in the text, which is what I'm after. text always returns None. articleBody is the only field that can save all the metadata with the urls I need, but that is only available from a direct link https://user.fanbox.cc/posts/postID

When batchdownloading from https://user.fanbox.cc/ I just can't fetch the urls from the individual posts at all.

That's a lot of links that I would have to input in a list, it's not practical in the time of subscription I have left.

afterdelight commented 2 years ago

use link gopher addon then put them in a text file

MrSeyker commented 2 years ago

Yeah, I used a link capture extension, I'll check that one, see how it's features are, tho.