search

datawhores / OF-Scraper

A completely revamped and redesigned fork, reimagined from scratch based on the original onlyfans-scraper
MIT License
655 stars 54 forks source link

database disk image is malformed #416

Closed dvkrav closed 3 months ago

dvkrav commented 3 months ago

Describe the bug

"database disk image is malformed" after authentication and choosing area to download

To Reproduce

  1. ofscraper --username modelName (currently subscribed to)
  2. Main Menu: What would you like to do? Perform Action(s)
  3. Action Menu: What action(s) would you like to take? Download content from a user
  4. Scrape entire paid page False
  5. Which area(s) would you do you want to download ['Profile']

Expected behavior

Download should start

Screenshots/Logs

$ ofscraper --username modelName Auto updating config... [logs.printStartValues:30] Log Level: DEBUG logs.py:30 [logs.printStartValues:31] 3.10.6 logs.py:31 [logs.printStartValues:36] config path: logs.py:36 /Users/your_username/.config/ofscraper/config.json
[logs.printStartValues:37] profile path: logs.py:37 /Users/your_username/.config/ofscraper/main_profile
[logs.printStartValues:38] log folder: logs.py:38 /Users/your_username/.config/ofscraper/logging

( )( \ ( ( ( )( )( )( ( __ ) | ( ) || ( \/ | ( \/| ( \/| ( )|| ( ) || ( )|| ( \/| ( )| | | | || ( | ( | | | ()|| (_) || (__)|| ( | (__)| | | | || _) ()( )| | | )| || _)| ) | _) | | | || ( ) || | | (\ ( | ( ) || ( | ( | (\ (
| () || ) /_) || (___/| ) \ \| ) ( || ) | (/| ) \ _ ()|/ ___)(/|/ _/|/ ||/
(_/|/ __/

Version 3.10.6 Key Mode: cdrm

CDM service seems to be working

WARNING:Make sure you have all the correct settings for choosen cdm https://of-scraper.gitbook.io/of-scraper/cdm-options

? Main Menu: What would you like to do? Perform Action(s)

? Action Menu: What action(s) would you like to take? Download content from a us er

? Scrape entire paid page

[Warning: initial Scan can be slow] [Caution: You should not need this unless you are looking to scrape paid content from a deleted/banned model] False [scrape_context.scrape_context_manager:28] scrape_context.py:28 ==============================
starting script
==============================

[tools.print_current_profile:37] Using profile: main_profile tools.py:37 Status - UP OF-Scraper ╭───────────────────────────── Activity Progress ──────────────────────────────╮ ╰──────────────────────────────────────────────────────────────────────────────╯

Which area(s) would you do you want to download ['Profile'] Welcome, user | userId Warning: Numbering on OF site can be iffy Example Including deactived accounts in expired See: https://of-scraper.gitbook.io/of-scraper/faq#number-of-users-doesnt-match-accoun t-number [close.sendCloseMessage:41] Finished Script close.py:41 database disk image is malformed Traceback (most recent call last): File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/runner/run.p y", line 17, in main main_helper() File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/runner/run.p y", line 44, in main_helper picker.pick() File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/commands/hel pers/picker.py", line 17, in pick actions.main() File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/commands/scr aper/scraper.py", line 95, in main raise E File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/commands/scr aper/scraper.py", line 77, in main scrapper() File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/commands/scr aper/scraper.py", line 112, in scrapper process_prompts() File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/utils/contex t/exit.py", line 92, in inner raise E File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/utils/contex t/exit.py", line 85, in inner return func(*args, kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/commands/scr aper/scraper.py", line 58, in process_prompts if menu.main_menu_action(): ^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/utils/menu.p y", line 41, in main_menu_action runner() File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/utils/contex t/exit.py", line 92, in inner raise E File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/utils/contex t/exit.py", line 85, in inner return func(*args, *kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/commands/scr aper/runner.py", line 57, in runner userdata, session = prepare() ^^^^^^^^^ File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/commands/scr aper/runner.py", line 74, in prepare userdata = userselector.getselected_usernames(rescan=False) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/models/selec tor.py", line 88, in getselected_usernames all_subs_helper(refetch=False) File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/utils/contex t/run_async.py", line 29, in inner raise E File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/utils/contex t/run_async.py", line 15, in inner tasks = loop.run_until_complete(coro(args, kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/Cellar/python@3.12/3.12.1/Frameworks/Python.framework/Versions/3.12/ lib/python3.12/asyncio/base_events.py", line 684, in run_until_complete return future.result() ^^^^^^^^^^^^^^^ File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/models/selec tor.py", line 124, in all_subs_helper ALL_SUBS = await retriver.get_models() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/models/retri ver.py", line 28, in get_models return await get_via_individual() ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/models/retri ver.py", line 60, in get_via_individual raise Exception("Provided usernames did not yield any valid models") Exception: Provided usernames did not yield any valid models

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/runner/load. py", line 27, in main run.main() File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/runner/run.p y", line 31, in main exit_manager.shutdown() File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/runner/exit. py", line 12, in shutdown closeCache() File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/runner/exit. py", line 29, in closeCache raise E File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/runner/exit. py", line 23, in closeCache cache = Cache( ^^^^^^ File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/diskcache/core.py", line 456, in init sql = self._sql_retry ^^^^^^^^^^^^^^^ File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/diskcache/core.py", line 652, in _sql_retry sql = self._sql ^^^^^^^^^ File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/diskcache/core.py", line 648, in _sql return self._con.execute ^^^^^^^^^ File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/diskcache/core.py", line 636, in _con settings = con.execute(select).fetchall() ^^^^^^^^^^^^^^^^^^^ sqlite3.DatabaseError: database disk image is malformed

--- Logging error --- Traceback (most recent call last): File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/runner/run.p y", line 17, in main main_helper() File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/runner/run.p y", line 44, in main_helper picker.pick() File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/commands/hel pers/picker.py", line 17, in pick actions.main() File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/commands/scr aper/scraper.py", line 95, in main raise E File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/commands/scr aper/scraper.py", line 77, in main scrapper() File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/commands/scr aper/scraper.py", line 112, in scrapper process_prompts() File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/utils/contex t/exit.py", line 92, in inner raise E File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/utils/contex t/exit.py", line 85, in inner return func(*args, kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/commands/scr aper/scraper.py", line 58, in process_prompts if menu.main_menu_action(): ^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/utils/menu.p y", line 41, in main_menu_action runner() File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/utils/contex t/exit.py", line 92, in inner raise E File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/utils/contex t/exit.py", line 85, in inner return func(*args, *kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/commands/scr aper/runner.py", line 57, in runner userdata, session = prepare() ^^^^^^^^^ File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/commands/scr aper/runner.py", line 74, in prepare userdata = userselector.getselected_usernames(rescan=False) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/models/selec tor.py", line 88, in getselected_usernames all_subs_helper(refetch=False) File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/utils/contex t/run_async.py", line 29, in inner raise E File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/utils/contex t/run_async.py", line 15, in inner tasks = loop.run_until_complete(coro(args, kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/Cellar/python@3.12/3.12.1/Frameworks/Python.framework/Versions/3.12/ lib/python3.12/asyncio/base_events.py", line 684, in run_until_complete return future.result() ^^^^^^^^^^^^^^^ File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/models/selec tor.py", line 124, in all_subs_helper ALL_SUBS = await retriver.get_models() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/models/retri ver.py", line 28, in get_models return await get_via_individual() ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/models/retri ver.py", line 60, in get_via_individual raise Exception("Provided usernames did not yield any valid models") Exception: Provided usernames did not yield any valid models

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/runner/load. py", line 27, in main run.main() File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/runner/run.p y", line 31, in main exit_manager.shutdown() File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/runner/exit. py", line 12, in shutdown closeCache() File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/runner/exit. py", line 29, in closeCache raise E File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/runner/exit. py", line 23, in closeCache cache = Cache( ^^^^^^ File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/diskcache/core.py", line 456, in init sql = self._sql_retry ^^^^^^^^^^^^^^^ File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/diskcache/core.py", line 652, in _sql_retry sql = self._sql ^^^^^^^^^ File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/diskcache/core.py", line 648, in _sql return self._con.execute ^^^^^^^^^ File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/diskcache/core.py", line 636, in _con settings = con.execute(select).fetchall() ^^^^^^^^^^^^^^^^^^^ sqlite3.DatabaseError: database disk image is malformed

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/usr/local/Cellar/python@3.12/3.12.1/Frameworks/Python.framework/Versions/3.12/ lib/python3.12/logging/handlers.py", line 1497, in emit self.enqueue(self.prepare(record)) File "/usr/local/Cellar/python@3.12/3.12.1/Frameworks/Python.framework/Versions/3.12/ lib/python3.12/logging/handlers.py", line 1455, in enqueue self.queue.put_nowait(record) File "", line 2, in put_nowait File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/multiprocess/managers. py", line 820, in _callmethod conn.send((self._id, methodname, args, kwds)) File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/multiprocess/connectio n.py", line 209, in send self._send_bytes(_ForkingPickler.dumps(obj)) File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/multiprocess/connectio n.py", line 430, in _send_bytes self._send(header + buf) File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/multiprocess/connectio n.py", line 387, in _send n = write(self._handle, buf) ^^^^^^^^^^^^^^^^^^^^^^^^ BrokenPipeError: [Errno 32] Broken pipe Call stack: File "/Users/user/.local/bin/ofscraper", line 10, in sys.exit(main()) File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/main.py" , line 10, in main load.main() File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/runner/load. py", line 32, in main logging.getLogger("shared").debug(traceback.format_exc()) Message: 'Traceback (most recent call last):\n File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/runner/run.p y", line 17, in main\n main_helper()\n File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/runner/run.p y", line 44, in main_helper\n picker.pick()\n File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/commands/hel pers/picker.py", line 17, in pick\n actions.main()\n File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/commands/scr aper/scraper.py", line 95, in main\n raise E\n File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/commands/scr aper/scraper.py", line 77, in main\n scrapper()\n File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/commands/scr aper/scraper.py", line 112, in scrapper\n process_prompts()\n File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/utils/contex t/exit.py", line 92, in inner\n raise E\n File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/utils/contex t/exit.py", line 85, in inner\n return func(*args, kwargs)\n
^^^^^^^^^^^^^^^^^^^^^\n File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/commands/scr aper/scraper.py", line 58, in process_prompts\n if menu.main_menu_action():\n ^^^^^^^^^^^^^^^^^^^^^^^\n File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/utils/menu.p y", line 41, in main_menu_action\n runner()\n File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/utils/contex t/exit.py", line 92, in inner\n raise E\n File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/utils/contex t/exit.py", line 85, in inner\n return func(*args, *kwargs)\n
^^^^^^^^^^^^^^^^^^^^^\n File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/commands/scr aper/runner.py", line 57, in runner\n userdata, session = prepare()\n
^^^^^^^^^\n File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/commands/scr aper/runner.py", line 74, in prepare\n userdata = userselector.getselected_usernames(rescan=False)\n
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/models/selec tor.py", line 88, in getselected_usernames\n all_subs_helper(refetch=False)\n File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/utils/contex t/run_async.py", line 29, in inner\n raise E\n File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/utils/contex t/run_async.py", line 15, in inner\n tasks = loop.run_until_complete(coro(args, kwargs))\n
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/Cellar/python@3.12/3.12.1/Frameworks/Python.framework/Versions/3.12/ lib/python3.12/asyncio/base_events.py", line 684, in run_until_complete\n
return future.result()\n ^^^^^^^^^^^^^^^\n File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/models/selec tor.py", line 124, in all_subs_helper\n ALL_SUBS = await retriver.get_models()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/models/retri ver.py", line 28, in get_models\n return await get_via_individual()\n
^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/models/retri ver.py", line 60, in get_via_individual\n raise Exception("Provided usernames did not yield any valid models")\nException: Provided usernames did not yield any valid models\n\nDuring handling of the above exception, another exception occurred:\n\nTraceback (most recent call last):\n File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/runner/load. py", line 27, in main\n run.main()\n File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/runner/run.p y", line 31, in main\n exit_manager.shutdown()\n File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/runner/exit. py", line 12, in shutdown\n closeCache()\n File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/runner/exit. py", line 29, in closeCache\n raise E\n File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/runner/exit. py", line 23, in closeCache\n cache = Cache(\n ^^^^^^\n File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/diskcache/core.py", line 456, in init\n sql = self._sql_retry\n ^^^^^^^^^^^^^^^\n
File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/diskcache/core.py", line 652, in _sql_retry\n sql = self._sql\n ^^^^^^^^^\n File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/diskcache/core.py", line 648, in _sql\n return self._con.execute\n ^^^^^^^^^\n File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/diskcache/core.py", line 636, in _con\n settings = con.execute(select).fetchall()\n
^^^^^^^^^^^^^^^^^^^\nsqlite3.DatabaseError: database disk image is malformed\n' Arguments: () --- Logging error --- Traceback (most recent call last): File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/runner/run.p y", line 17, in main main_helper() File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/runner/run.p y", line 44, in main_helper picker.pick() File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/commands/hel pers/picker.py", line 17, in pick actions.main() File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/commands/scr aper/scraper.py", line 95, in main raise E File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/commands/scr aper/scraper.py", line 77, in main scrapper() File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/commands/scr aper/scraper.py", line 112, in scrapper process_prompts() File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/utils/contex t/exit.py", line 92, in inner raise E File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/utils/contex t/exit.py", line 85, in inner return func(*args, kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/commands/scr aper/scraper.py", line 58, in process_prompts if menu.main_menu_action(): ^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/utils/menu.p y", line 41, in main_menu_action runner() File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/utils/contex t/exit.py", line 92, in inner raise E File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/utils/contex t/exit.py", line 85, in inner return func(*args, *kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/commands/scr aper/runner.py", line 57, in runner userdata, session = prepare() ^^^^^^^^^ File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/commands/scr aper/runner.py", line 74, in prepare userdata = userselector.getselected_usernames(rescan=False) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/models/selec tor.py", line 88, in getselected_usernames all_subs_helper(refetch=False) File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/utils/contex t/run_async.py", line 29, in inner raise E File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/utils/contex t/run_async.py", line 15, in inner tasks = loop.run_until_complete(coro(args, kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/Cellar/python@3.12/3.12.1/Frameworks/Python.framework/Versions/3.12/ lib/python3.12/asyncio/base_events.py", line 684, in run_until_complete return future.result() ^^^^^^^^^^^^^^^ File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/models/selec tor.py", line 124, in all_subs_helper ALL_SUBS = await retriver.get_models() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/models/retri ver.py", line 28, in get_models return await get_via_individual() ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/models/retri ver.py", line 60, in get_via_individual raise Exception("Provided usernames did not yield any valid models") Exception: Provided usernames did not yield any valid models

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/runner/load. py", line 27, in main run.main() File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/runner/run.p y", line 31, in main exit_manager.shutdown() File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/runner/exit. py", line 12, in shutdown closeCache() File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/runner/exit. py", line 29, in closeCache raise E File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/runner/exit. py", line 23, in closeCache cache = Cache( ^^^^^^ File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/diskcache/core.py", line 456, in init sql = self._sql_retry ^^^^^^^^^^^^^^^ File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/diskcache/core.py", line 652, in _sql_retry sql = self._sql ^^^^^^^^^ File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/diskcache/core.py", line 648, in _sql return self._con.execute ^^^^^^^^^ File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/diskcache/core.py", line 636, in _con settings = con.execute(select).fetchall() ^^^^^^^^^^^^^^^^^^^ sqlite3.DatabaseError: database disk image is malformed

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/usr/local/Cellar/python@3.12/3.12.1/Frameworks/Python.framework/Versions/3.12/ lib/python3.12/logging/handlers.py", line 1497, in emit self.enqueue(self.prepare(record)) File "/usr/local/Cellar/python@3.12/3.12.1/Frameworks/Python.framework/Versions/3.12/ lib/python3.12/logging/handlers.py", line 1455, in enqueue self.queue.put_nowait(record) File "", line 2, in put_nowait File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/multiprocess/managers. py", line 820, in _callmethod conn.send((self._id, methodname, args, kwds)) File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/multiprocess/connectio n.py", line 209, in send self._send_bytes(_ForkingPickler.dumps(obj)) File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/multiprocess/connectio n.py", line 430, in _send_bytes self._send(header + buf) File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/multiprocess/connectio n.py", line 387, in _send n = write(self._handle, buf) ^^^^^^^^^^^^^^^^^^^^^^^^ BrokenPipeError: [Errno 32] Broken pipe Call stack: File "/Users/user/.local/bin/ofscraper", line 10, in sys.exit(main()) File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/main.py" , line 10, in main load.main() File "/Users/user/Library/Application Support/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/runner/load. py", line 33, in main logging.getLogger("shared").debug(E) Message: DatabaseError('database disk image is malformed')

Config

{ "main_profile": "main_profile", "metadata": "{configpath}/{profile}/.data/{modelusername}{model_id}", "discord": "", "file_options": { "save_location": "/onlyfans/", "dir_format": "{model_username}/{responsetype}/{mediatype}/", "file_format": "{filename}.{ext}", "textlength": 0, "space_replacer": " ", "date": "MM-DD-YYYY", "text_type_default": "letter", "truncation_default": true }, "download_options": { "file_size_max": 0, "file_size_min": 0, "filter": [ "Images", "Audios", "Videos" ], "auto_resume": true, "system_free_min": 0, "max_post_count": 0 }, "binary_options": { "mp4decrypt": "/Users/user/Downloads/Bento4-SDK-1-6-0-641.universal-apple-macosx/bin/mp4decrypt", "ffmpeg": "/Users/user/Downloads/ffmpeg" }, "cdm_options": { "private-key": null, "client-id": null, "key-mode-default": "cdrm", "keydb_api": "" }, "performance_options": { "download-sem": 6, "threads": 2 }, "advanced_options": { "code-execution": false, "dynamic-mode-default": "growik", "backend": "aio", "downloadbars": false, "cache-mode": "sqlite", "appendlog": true, "custom_values": null, "sanitize_text": false, "temp_dir": null, "remove_hash_match": false, "infinite_loop_action_mode": false, "post_download_script": null, "disable_auto_after": false, "default_user_list": "main", "default_black_list": "" }, "responsetype": { "timeline": "Posts", "message": "Messages", "archived": "Archived", "paid": "Messages", "stories": "Stories", "highlights": "Stories", "profile": "Profile", "pinned": "Posts" }, "overwrites": { "audios": {}, "videos": {}, "images": {}, "text": {} } }

System Info

dvkrav commented 3 months ago

Anyone can guide how to fix this issue ?

dvkrav commented 3 months ago

@datawhores can you please help ? I cant download anything because of this issue

datawhores commented 3 months ago

Was this fixed? I was away for a bit.