shadowmoose / RedditDownloader

Scrapes Reddit to download media of your choice.
1.11k stars 99 forks source link

RMD-ubuntu never finishes #227

Open studog opened 3 years ago

studog commented 3 years ago

Describe the bug

I just upgraded to RMD-ubuntu 3.1.5. from 3.1.0. I have wiped my entire download directory, including my manifest.sqlite and upgraded my PIP packages. This new version seems to never finish its run. I launch the RMD-ubuntu from the commandline and let it run all night and I come back to Remaining: 1/280. Not sure if this is something on my end or not.

Environment Info

==================================== Reddit Media Downloader 3.1.5

(By ShadowMoose @ Github)

### Screenshots/Information

Remaining: 1/280

File: None Handler: None Status: Waiting for URL...

File: None Handler: None Status: Waiting for URL...

File: None Handler: None Status: Waiting for URL...

File: None Handler: None Status: Waiting for URL...

File: None Handler: None Status: Waiting for URL...


### Additional context
settings.json, key info removed .

{ "auth": { "oauth_key": "oauth_key", "refresh_token": "refresh_token", "rmd_client_key": "rmd_client_key", "user_agent": "user_agent" }, "imgur": { "client_id": "client_id", "client_secret": "client_secret" }, "interface": { "browser": "off", "host": "localhost", "keep_open": false, "port": 7505, "start_server": false }, "misc": { "meta-version": 6, "sources": [ { "alias": "NewStuffs", "data": { "limit": 20, "order": "new", "subreddit": "29,SUB,Reddits ", "time": "all" }, "filters": {}, "type": "subreddit-posts-source" }, { "alias": "TopStuffs", "data": { "limit": 20, "order": "top", "subreddit": "29,SUB,Reddits", "time": "all" }, "filters": {}, "type": "subreddit-posts-source" } ] }, "output": { "base_dir": "/USER/stuff/RMD/download", "file_name_pattern": "[subreddit]/[subreddit] - [title] - ([author])", "manifest": "./manifest.sqlite" }, "processing": { "deduplicate_files": true, "retry_failed": false }, "threading": { "concurrent_downloads": 5, "console_clear_screen": true, "display_refresh_rate": 5 } }

shadowmoose commented 3 years ago

Hey, thanks for the report. To be clear, is this fixed when you relaunch, or does it persist?

studog commented 3 years ago

This does persist when re-launching. I was hoping maybe it was just taking a bit on the first run but even after I stop and restart it, the issue remains. Ive tried changing the concurrent_downloads between 5 and 10 and that does not seem to change anything. A few of my runs also have been stalling out on the download itself. it will grab an image or a video file and just hang. The videos will get a percentage in and just hang.