DIGITALCRIMINAL / ArchivedUltimaScraper

Scrape content from OnlyFans and Fansly
GNU General Public License v3.0
932 stars 39 forks source link

Stuck on Scraping Paid Content #274

Closed LCP93 closed 2 years ago

LCP93 commented 2 years ago

After the recent update the downloader is getting stuck at scraping paid content. I've tried it several times and it just hangs there without downloading anything, any idea how to fix this?

krangle commented 2 years ago

yeah in certain cases (only checked OF) it tries to scrape all that you follow instead of just the one you input

If any help, when using keyboard interrupt to stop -

Traceback (most recent call last):
  File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.10_3.10.496.0_x64__qbz5n2kfra8p0\lib\pathlib.py", line 1288, in exists
    self.stat()
  File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.10_3.10.496.0_x64__qbz5n2kfra8p0\lib\pathlib.py", line 1095, in stat
    return self._accessor.stat(self, follow_symlinks=follow_symlinks)
FileNotFoundError: [WinError 2] The system cannot find the file specified: '.sites\\OnlyFans\\MODELNAME\\Metadata\\.sites\\OnlyFans\\MODELNAME\\Metadata\\user_data.db'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\Users\username\Downloads\OnlyFans-master(4)\OnlyFans-master\start_ofd.py", line 75, in <module>
    asyncio.run(main())
  File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.10_3.10.496.0_x64__qbz5n2kfra8p0\lib\asyncio\runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.10_3.10.496.0_x64__qbz5n2kfra8p0\lib\asyncio\base_events.py", line 628, in run_until_complete
    self.run_forever()
  File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.10_3.10.496.0_x64__qbz5n2kfra8p0\lib\asyncio\windows_events.py", line 316, in run_forever
    super().run_forever()
  File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.10_3.10.496.0_x64__qbz5n2kfra8p0\lib\asyncio\base_events.py", line 595, in run_forever
    self._run_once()
  File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.10_3.10.496.0_x64__qbz5n2kfra8p0\lib\asyncio\base_events.py", line 1881, in _run_once
    handle._run()
  File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.10_3.10.496.0_x64__qbz5n2kfra8p0\lib\asyncio\events.py", line 80, in _run
    self._context.run(self._callback, *self._args)
  File "C:\Users\username\Downloads\OnlyFans-master(4)\OnlyFans-master\start_ofd.py", line 61, in main
    api = await main_datascraper.start_datascraper(config, site_name_lower)
  File "C:\Users\username\Downloads\OnlyFans-master(4)\OnlyFans-master\datascraper\main_datascraper.py", line 126, in start_datascraper
    await default(datascraper)
  File "C:\Users\username\Downloads\OnlyFans-master(4)\OnlyFans-master\datascraper\main_datascraper.py", line 95, in default
    await main_helper.process_jobs(datascraper, subscription_list, site_settings)
  File "C:\Users\username\Downloads\OnlyFans-master(4)\OnlyFans-master\helpers\main_helper.py", line 1015, in process_jobs
    await datascraper.paid_content_scraper(authed)  # type: ignore
  File "C:\Users\username\Downloads\OnlyFans-master(4)\OnlyFans-master\modules\onlyfans.py", line 185, in paid_content_scraper
    await main_helper.format_directories(
  File "C:\Users\username\Downloads\OnlyFans-master(4)\OnlyFans-master\helpers\main_helper.py", line 1347, in format_directories
    if metadata_filepath.exists() and not new_m_f.exists():
  File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.10_3.10.496.0_x64__qbz5n2kfra8p0\lib\pathlib.py", line 1288, in exists
    self.stat()
KeyboardInterrupt
^C
DIGITALCRIMINAL commented 2 years ago

@krangle are you a creator?

rileypollard12 commented 2 years ago

Same issue, creator account

Site3op commented 2 years ago

Same issue, not a creator account.

clarry76 commented 2 years ago

Has anyone got a work around for this yet? Used the recent update because the last one deleted all my files, and now I cannot download anything. Thankyou for all the help.

DIGITALCRIMINAL commented 2 years ago

I'm pushing a new commit that will fix this within the next hour.

I just wanna make sure it runs properly.

DIGITALCRIMINAL commented 2 years ago

Try the latest commit

krangle commented 2 years ago

a note, it didnt work for me with the latest commit for some reason, ran updater.py just to see what it did, idk what it did but now its working okay, might be unrelated idk

DIGITALCRIMINAL commented 2 years ago

Updater.py grabs the latest commit

DIGITALCRIMINAL commented 2 years ago

Closing for https://github.com/DIGITALCRIMINALS/OnlyFans/issues/268