search

shadowmoose / RedditDownloader

Scrapes Reddit to download media of your choice.
1.12k stars 101 forks source link

Missing downloads/failed downloads #169

Open prisoneer opened 3 years ago

prisoneer commented 3 years ago

Describe the bug

RMD not downloading all of my saved posts

Environment Info

Screenshots/Information

These are the errors: https://pastebin.com/gsnjyAFS

Some of the posts that RMD didn't download and which are not in the Failed Downloads too: https://www.reddit.com/r/awfuleverything/comments/j0x54u/antipalm_oil_advertisement_depicting_destruction/ https://www.reddit.com/r/MadeMeSmile/comments/j110g1/so_incredibly_wholesome/ https://www.reddit.com/r/MakeMeSuffer/comments/j0fpxd/kidney_stones/ https://www.reddit.com/r/todayilearned/comments/j07qj9/til_that_crows_and_owls_hate_each_other_on_their/ https://www.reddit.com/r/CrappyDesign/comments/j06wsl/this_woman_turning_into_fish_roll/ https://www.reddit.com/r/PublicFreakout/comments/j03quz/lapd_officer_uses_shield_to_smash_protestors_ankle/

Additional context

So I decided to scroll down to the bottom of my "Saved posts" page and wanted to make sure if everything is downloaded and then I noticed that many of the posts are missing in the download folder and also missing in the Failed downloads list.

shadowmoose commented 3 years ago

Thanks for including the log and examples. It looks like a lot of connections to Reddit's media servers are failing - are you perhaps having connection problems with their site?

prisoneer commented 3 years ago

Thanks for including the log and examples. It looks like a lot of connections to Reddit's media servers are failing - are you perhaps having connection problems with their site?

I don't think I've had connection problems because all of the posts that I saved, I was able to see from the first time without any problems. I was browsing Reddit while the downloader was working.

I just pinged reddit Ping statistics for 151.101.1.140: Packets: Sent = 275, Received = 275, Lost = 0 (0% loss), Approximate round trip times in milli-seconds: Minimum = 32ms, Maximum = 38ms, Average = 33ms

shadowmoose commented 3 years ago

Strange, the basic HTTP requests seem to be failing in your logs at a high rate. Is the media in the original Reddit posts generally still there, or have they been deleted?