search

datawhores / OF-Scraper

A completely revamped and redesigned fork, reimagined from scratch based on the original onlyfans-scraper
MIT License
701 stars 59 forks source link

"Too many open files" error crashing scraper #470

Closed TheTrueColonel closed 3 weeks ago

TheTrueColonel commented 1 month ago

Describe the bug

When using the scraper, after about 33 users scraped, the program will crash and go back to the main menu.

To Reproduce

Steps to reproduce the behavior: Hint: enter the command and args would be a good idea

Example

  1. Run ofscraper command
  2. Select over 33 users to scrape
  3. Wait until crash

Expected behavior

Scraper does not crash do to too many open files.

Screenshots/Logs

Logs

Config

Config

System Info

A-Random-Mf commented 1 month ago

Sounds like ulimit https://askubuntu.com/questions/1182021/too-many-open-files

SSj-Saturn commented 5 days ago

This has suddenly started happening for me too, and my ulimit is set to unlimited. Never been an issue before.