datawhores / OF-Scraper

A completely revamped and redesigned fork, reimagined from scratch based on the original onlyfans-scraper
MIT License
699 stars 59 forks source link

[3.10.7] Slow and stuck #425

Closed CannotTouch closed 5 months ago

CannotTouch commented 5 months ago

It worked correctly, very slow on some action (not the download), and downloaded the contents but it get stucked from 20 min now.

In the log there aren't errors:

2024-06-20 10:32:07:[main_downloadbatch.main_download_sendreq:188]  Media:3245553723 Post:984918105  download temp path E:\ofscraper-main\Data\ofscraper\XXX\0hnxpin4upkuizw614r7w_source_3245553723.part
 2024-06-20 10:32:42:[log.path_to_file_logger:16]  Media:3245553723 Post:984918105 [attempt 1/10] filename from config 0hnxpin4upkuizw614r7w_source.mp4
 2024-06-20 10:32:42:[log.path_to_file_logger:19]  Media:3245553723 Post:984918105 [attempt 1/10] full path from config E:\ofscraper-main\Data\ofscraper\XXX\0hnxpin4upkuizw614r7w_source.mp4
 2024-06-20 10:32:42:[log.path_to_file_logger:22]  Media:3245553723 Post:984918105 [attempt 1/10] full path trunicated from config E:\ofscraper-main\Data\ofscraper\XXX\0hnxpin4upkuizw614r7w_source.mp4
 2024-06-20 10:37:58:[main_downloadbatch.send_req_inner:245]  Media:3163474760 Post:1055109771  finished writing media to disk
 2024-06-20 10:37:58:[handle_result.handle_result_main:25]  Media:3163474760 Post:1055109771 0hlv5bh6gpq8uu7mk8qx9_source size match target: 728973194 vs actual: 728973194
 2024-06-20 10:37:58:[handle_result.handle_result_main:28]  Media:3163474760 Post:1055109771 renaming E:\ofscraper-main\Data\ofscraper\XXX\0hlv5bh6gpq8uu7mk8qx9_source_3163474760.part -> E:\ofscraper-main\Data\ofscraper\XXX\0hlv5bh6gpq8uu7mk8qx9_source.mp4
 2024-06-20 10:37:58:[handle_result.handle_result_main:39]  Media:3163474760 Post:1055109771 Attempt to set Date to 2024-05-05 13:28
 2024-06-20 10:37:58:[handle_result.handle_result_main:43]  Media:3163474760 Post:1055109771 Date set to 2024-05-05 13:28
 2024-06-20 10:32:20:[main_downloadbatch.main_download:62]  Media:3163474760 Post:1055109771 Downloading with normal batch downloader
 2024-06-20 10:32:20:[main_downloadbatch.main_download:65]  Media:3163474760 Post:1055109771 download url: https://cdn2.onlyfans.com/files/3/3a/{hidden}/{hidden}.mp4?Tag=2&Policy={hidden}&Signature={hidden}&Key-Pair-Id={hidden}
 2024-06-20 10:32:24:[main_downloadbatch.main_download_sendreq:188]  Media:3163474760 Post:1055109771  download temp path E:\ofscraper-main\Data\ofscraper\XXX\0hlv5bh6gpq8uu7mk8qx9_source_3163474760.part
 2024-06-20 10:33:22:[log.path_to_file_logger:16]  Media:3163474760 Post:1055109771 [attempt 1/10] filename from config 0hlv5bh6gpq8uu7mk8qx9_source.mp4
 2024-06-20 10:33:22:[log.path_to_file_logger:19]  Media:3163474760 Post:1055109771 [attempt 1/10] full path from config E:\ofscraper-main\Data\ofscraper\XXX\0hlv5bh6gpq8uu7mk8qx9_source.mp4
 2024-06-20 10:33:22:[log.path_to_file_logger:22]  Media:3163474760 Post:1055109771 [attempt 1/10] full path trunicated from config E:\ofscraper-main\Data\ofscraper\XXX\0hlv5bh6gpq8uu7mk8qx9_source.mp4
 2024-06-20 10:38:00:[downloadbatch.consumer:357]  unpack ('videos', 728973194) count 2

The prompt show:

╭───────────────────────────────────────────────── Activity Progress ──────────────────────────────────────────────────╮
│ Performing Downloading Action on XXX                                                                      │
│ Saving files to E:\ofscraper-main\Data\ofscraper\XXX\{filename}.{ext}                                     │
│ Users with Actions Completed ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1/2 │
╰──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
╭──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│ Progress: (201 photos, 78 videos, 0 audios, 0 skipped, 0 failed || 279/279||3.47 GB/3.47 GB) ━━━━━━━━━━━━━━━━━━ 100% │
╰──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
╭──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│

This is another run with 7 users to scrape, (no the same of the before) and it stuck again at the end of the first one (that is scraped correctly):

╭───────────────────────────────────────────────── Activity Progress ──────────────────────────────────────────────────╮
│ Performing Downloading Action on XXX                                                                         │
│ Saving files to E:\ofscraper-main\Data\ofscraper\XXX\{filename}.{ext}                                        │
│ Users with Actions Completed ━━━━━━━━━━━╸━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1/7 │
╰──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
╭──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│ Progress: (78 photos, 7 videos, 0 audios, 0 skipped, 0 failed || 85/85||109.11 MB/109.11 MB) ━━━━━━━━━━━━━━━━━━ 100% │
╰──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
╭──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

Let me know if you need more info. Thanks for support

CannotTouch commented 5 months ago

The stuck is solved with the https://github.com/datawhores/OF-Scraper/commit/b1ad92925b6fb8add3c52be78a94c71cef1c4c04