DIGITALCRIMINAL / ArchivedUltimaScraper

Scrape content from OnlyFans and Fansly
GNU General Public License v3.0
932 stars 39 forks source link

OF scraper only downloading first image/video of a set #250

Closed lubedandready closed 2 years ago

lubedandready commented 2 years ago

I don't know if it's just me, but when I run the Onlyfans scraper, only the first thing is downloaded from a set. This happens in both paid and free posts/messages. Was wondering if there was a setting in the config.json I messed with that I shouldn't have or something. Looking back, I guess it happened in previous versions too, I just never noticed until I took a look into my paid image sets.

d3ibis commented 2 years ago

For me working fine, all set is downloaded even paid and paid in messages.

lubedandready commented 2 years ago

Yeah, that's what I thought. I'll try to do a clean install later. I guess I should post my settings, just in case. Idk what it'd be, though, if it were a config setting.

"onlyfans": {
      "settings": {
        "auto_profile_choice": [],
        "auto_model_choice": false,
        "auto_media_choice": "",
        "auto_api_choice": true,
        "browser": {
          "auth": true
        },
        "jobs": {
          "scrape_names": true,
          "scrape_paid_content": false
        },
        "download_directories": [
          ".sites"
        ],
        "file_directory_format": "{site_name}\\{model_username}\\{api_type}\\{value}\\{media_type}",
        "filename_format": "{date}.{ext}",
        "metadata_directories": [
          ".sites"
        ],
        "metadata_directory_format": "{site_name}\\{model_username}\\Metadata",
        "delete_legacy_metadata": false,
        "text_length": 255,
        "video_quality": "source",
        "overwrite_files": false,
        "date_format": "%Y-%m-%d",
        "ignored_keywords": [],
        "ignore_type": "",
        "blacklists": [],
        "webhook": true
      }
    },
d3ibis commented 2 years ago

For this ("scrape_paid_content": false) in my config.json is set to true & it is the only difference but i think it has nothing to do with sets.

lubedandready commented 2 years ago

Alright, so I guess it could've been a few things. I updated my python to 3.10.1, but that still didn't fix the problem with the scraper install I had. Sets still weren't being downloaded fully. So, I just downloaded a fresh zip, redid the auth and config, and it works. Don't know which one it was, maybe it was both, but sorry for the trouble.