search

DIGITALCRIMINAL / ArchivedUltimaScraper

Scrape content from OnlyFans and Fansly
GNU General Public License v3.0
953 stars 39 forks source link

Takes forever, then stops #367

Closed LFS900 closed 1 year ago

LFS900 commented 2 years ago

So I've been trying to scrape content but for the last... 2 weeks it's been going really slow. Now in the past week, I select onlyfans (0), then default (1). I select the model and it just gets stuck at "Scrape Attempt: 1/100". I've been waiting for an hour now. It's not gonna happen. I Redownloaded the zip file, unpacked it, filled in the same info but the issue isn't gone. When it does continue and sometimes it does, it gets stuck at "Type: Messages". I've been waiting another 2 hours now for that to move.

DIGITALCRIMINAL commented 2 years ago

Which model

LFS900 commented 2 years ago

Any I choose. If I choose "all", I have to correct myself. It takes extremely long and gets stuck at "Scraping Paid Content" for 10 minutes or even longer. However, it does work eventually. But if I choose any girl, it does not get passed "Type: Messages" even after an hour.

DIGITALCRIMINAL commented 2 years ago

Which model

LFS900 commented 2 years ago

All of them but to give an example... Selti

DIGITALCRIMINAL commented 2 years ago

How many cores does your CPU have

LFS900 commented 2 years ago

4

DIGITALCRIMINAL commented 2 years ago

If you've got a lot of subscriptions, it could take awhile to grab all of them

LFS900 commented 2 years ago

I only have about 9 atm. But I've had many in the past. Does it remember those when it scrapes for content or does it only depend on the active subscriptions? I've had 21 at once in the past and it worked way faster back then.

DIGITALCRIMINAL commented 2 years ago

Only depends on active.

It's not normal to take forever on 9, but only if you've got hundreds...

Maybe it's your Internet? You can try putting max_threads to 1 in the config settings.

LFS900 commented 2 years ago

What does that actually do? I tried it but it didn't change much. It might just be my internet then. Though nothing has changed in the past years. I'm using "ALL" lately since that's the only thing that still works... but I've noticed before it doesn't always scrap everything. I'll keep an eye on how true that is and if it's too severe, I might contact you again! Thanks for the help!