search

aliparlakci / bulk-downloader-for-reddit

Downloads and archives content from reddit
https://pypi.org/project/bdfr
GNU General Public License v3.0
2.26k stars 211 forks source link

[BUG] doesn't download saved comments #904

Open Zireael07 opened 1 year ago

Zireael07 commented 1 year ago

Description

I went to download latest saved posts, and noticed it skipped "jfzpldz is not a submission" and by looking at the list of what was just before and after that I figured out it was a single saved comment. Now that I remember, I know I saw similar messages when downloading my entire saved posts history a couple weeks before.... probably were single comments too.

Command

bdfr clone ./clonereddit --user username here --saved --authenticate -L 28

Environment (please complete the following information)

Logs

See comment below

Serene-Arc commented 1 year ago

Logs are NOT OPTIONAL. Please supply them or this issue will be closed.

Zireael07 commented 1 year ago

[2023-07-02 19:08:49,099 - bdfr.connector - DEBUG] - Disabling the following modules: [2023-07-02 19:08:49,099 - bdfr.connector - Level 9] - Created download filter [2023-07-02 19:08:49,099 - bdfr.connector - Level 9] - Created time filter [2023-07-02 19:08:49,099 - bdfr.connector - Level 9] - Created sort filter [2023-07-02 19:08:49,100 - bdfr.connector - Level 9] - Create file name formatter [2023-07-02 19:08:49,100 - bdfr.connector - DEBUG] - Using authenticated Reddit instance [2023-07-02 19:08:49,101 - bdfr.connector - Level 9] - Created site authenticator [2023-07-02 19:08:49,101 - bdfr.connector - Level 9] - Retrieved subreddits [2023-07-02 19:08:49,101 - bdfr.connector - Level 9] - Retrieved multireddits [2023-07-02 19:08:49,101 - bdfr.oauth2 - Level 9] - Loaded OAuth2 token for authoriser [2023-07-02 19:08:49,532 - bdfr.oauth2 - Level 9] - Written OAuth2 token from authoriser to /home/kasia/.config/bdfr/default_config.cfg [2023-07-02 19:08:50,000 - bdfr.connector - DEBUG] - Retrieving saved posts of user Zireael07 [2023-07-02 19:08:50,001 - bdfr.connector - Level 9] - Retrieved user data [2023-07-02 19:08:50,001 - bdfr.connector - Level 9] - Retrieved submissions for given links [2023-07-02 19:08:50,933 - bdfr.downloader - DEBUG] - Attempting to download submission 14obxuk [2023-07-02 19:08:50,937 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/dndnext/comments/14obxuk/wizards_seems_to_value_conditions_as_virtual/ [2023-07-02 19:08:51,201 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/dndnext/FallenDank_Wizards seems to value conditions as virtual damage when it comes to design_14obxuk.txt [2023-07-02 19:08:51,202 - bdfr.downloader - DEBUG] - Hash added to master list: d326d8914554075011f0edfdd1b4c8c7 [2023-07-02 19:08:51,202 - bdfr.downloader - INFO] - Downloaded submission 14obxuk from dndnext [2023-07-02 19:08:51,202 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 14obxuk [2023-07-02 19:08:51,872 - bdfr.archiver - DEBUG] - Writing entry 14obxuk to file in JSON format at /home/kasia/clonereddit/dndnext/FallenDank_Wizards seems to value conditions as virtual damage when it comes to design_14obxuk.json [2023-07-02 19:08:51,872 - bdfr.archiver - INFO] - Record for entry item 14obxuk written to disk [2023-07-02 19:08:51,872 - bdfr.downloader - DEBUG] - Attempting to download submission 14n8tb5 [2023-07-02 19:08:51,872 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/RPGdesign/comments/14n8tb5/looking_for_help_with_adding_abilities_that/ [2023-07-02 19:08:52,139 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/RPGdesign/snowbirdnerd_Looking for help with adding abilities that modify my dice pool mechanic._14n8tb5.txt [2023-07-02 19:08:52,139 - bdfr.downloader - DEBUG] - Hash added to master list: 1e9993d1b2bb5b7b3864a3dbf781d0b0 [2023-07-02 19:08:52,139 - bdfr.downloader - INFO] - Downloaded submission 14n8tb5 from RPGdesign [2023-07-02 19:08:52,139 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 14n8tb5 [2023-07-02 19:08:52,598 - bdfr.archiver - DEBUG] - Writing entry 14n8tb5 to file in JSON format at /home/kasia/clonereddit/RPGdesign/snowbirdnerd_Looking for help with adding abilities that modify my dice pool mechanic._14n8tb5.json [2023-07-02 19:08:52,598 - bdfr.archiver - INFO] - Record for entry item 14n8tb5 written to disk [2023-07-02 19:08:52,598 - bdfr.downloader - DEBUG] - Attempting to download submission 14mjemt [2023-07-02 19:08:52,599 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/rpg/comments/14mjemt/what_are_your_favorite_sub_systems_to_graft_onto/ [2023-07-02 19:08:52,888 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/rpg/Additional_Score_275_What are your favorite sub systems to graft onto other systems?_14mjemt.txt [2023-07-02 19:08:52,888 - bdfr.downloader - DEBUG] - Hash added to master list: 58dbc52c29c72e7f820b6af2473da069 [2023-07-02 19:08:52,889 - bdfr.downloader - INFO] - Downloaded submission 14mjemt from rpg [2023-07-02 19:08:52,889 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 14mjemt [2023-07-02 19:08:53,651 - bdfr.archiver - DEBUG] - Writing entry 14mjemt to file in JSON format at /home/kasia/clonereddit/rpg/Additional_Score_275_What are your favorite sub systems to graft onto other systems?_14mjemt.json [2023-07-02 19:08:53,652 - bdfr.archiver - INFO] - Record for entry item 14mjemt written to disk [2023-07-02 19:08:53,652 - bdfr.downloader - DEBUG] - Attempting to download submission 14l8raf [2023-07-02 19:08:53,652 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/r2ay00i9ar8b1.png [2023-07-02 19:08:54,024 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/neography/Flacson8528_Mongul, Hangul styled writing system for Mongolian_14l8raf.png [2023-07-02 19:08:54,025 - bdfr.downloader - DEBUG] - Hash added to master list: 26611ec01b0471ae828ed68eb0ad4ffe [2023-07-02 19:08:54,025 - bdfr.downloader - INFO] - Downloaded submission 14l8raf from neography [2023-07-02 19:08:54,026 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 14l8raf [2023-07-02 19:08:54,435 - bdfr.archiver - DEBUG] - Writing entry 14l8raf to file in JSON format at /home/kasia/clonereddit/neography/Flacson8528_Mongul, Hangul styled writing system for Mongolian_14l8raf.json [2023-07-02 19:08:54,437 - bdfr.archiver - INFO] - Record for entry item 14l8raf written to disk [2023-07-02 19:08:54,437 - bdfr.downloader - DEBUG] - Attempting to download submission 14ky1i6 [2023-07-02 19:08:54,437 - bdfr.downloader - DEBUG] - Using Gallery with url https://www.reddit.com/gallery/14ky1i6 [2023-07-02 19:08:54,816 - bdfr.file_name_formatter - Level 9] - Formatting filename with index 1 [2023-07-02 19:08:54,816 - bdfr.file_name_formatter - Level 9] - Formatting filename with index 2 [2023-07-02 19:08:55,141 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/neography/Ryjok_Heknik_Cursive Cuneform_14ky1i6_1.jpg [2023-07-02 19:08:55,141 - bdfr.downloader - DEBUG] - Hash added to master list: 4a4a70b36e751fa7f066bc37d5f1565c [2023-07-02 19:08:55,539 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/neography/Ryjok_Heknik_Cursive Cuneform_14ky1i6_2.jpg [2023-07-02 19:08:55,539 - bdfr.downloader - DEBUG] - Hash added to master list: 8d8be87153aec600dcca1c4f5f69bf16 [2023-07-02 19:08:55,539 - bdfr.downloader - INFO] - Downloaded submission 14ky1i6 from neography [2023-07-02 19:08:55,539 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 14ky1i6 [2023-07-02 19:08:55,914 - bdfr.archiver - DEBUG] - Writing entry 14ky1i6 to file in JSON format at /home/kasia/clonereddit/neography/Ryjok_Heknik_Cursive Cuneform_14ky1i6.json [2023-07-02 19:08:55,914 - bdfr.archiver - INFO] - Record for entry item 14ky1i6 written to disk [2023-07-02 19:08:55,914 - bdfr.downloader - DEBUG] - Attempting to download submission 14hu28p [2023-07-02 19:08:55,914 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/worldbuilding/comments/14hu28p/are_there_any_good_ways_to_make_both_sides_of_a/ [2023-07-02 19:08:56,182 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/worldbuilding/Aggressive_Novel1207_Are there any good ways to make both sides of a rebellion justified?_14hu28p.txt [2023-07-02 19:08:56,182 - bdfr.downloader - DEBUG] - Hash added to master list: a769ed5d879ddd37f4a91fff3c51b262 [2023-07-02 19:08:56,182 - bdfr.downloader - INFO] - Downloaded submission 14hu28p from worldbuilding [2023-07-02 19:08:56,182 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 14hu28p [2023-07-02 19:08:58,550 - bdfr.archiver - DEBUG] - Writing entry 14hu28p to file in JSON format at /home/kasia/clonereddit/worldbuilding/Aggressive_Novel1207_Are there any good ways to make both sides of a rebellion justified?_14hu28p.json [2023-07-02 19:08:58,551 - bdfr.archiver - INFO] - Record for entry item 14hu28p written to disk [2023-07-02 19:08:58,551 - bdfr.downloader - DEBUG] - Attempting to download submission 14h8dqf [2023-07-02 19:08:58,551 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/worldbuilding/comments/14h8dqf/why_are_religions_in_worldbuilding_often_just_a/ [2023-07-02 19:08:58,829 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/worldbuilding/Initial_Twist_3138_Why are religions in worldbuilding often just a reskinned Christianity (catholic)?_14h8dqf.txt [2023-07-02 19:08:58,830 - bdfr.downloader - DEBUG] - Hash added to master list: 2985201fa89977c0b676ab6626c1cee9 [2023-07-02 19:08:58,830 - bdfr.downloader - INFO] - Downloaded submission 14h8dqf from worldbuilding [2023-07-02 19:08:58,830 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 14h8dqf [2023-07-02 19:09:01,791 - bdfr.archiver - DEBUG] - Writing entry 14h8dqf to file in JSON format at /home/kasia/clonereddit/worldbuilding/Initial_Twist_3138_Why are religions in worldbuilding often just a reskinned Christianity (catholic)?_14h8dqf.json [2023-07-02 19:09:01,792 - bdfr.archiver - INFO] - Record for entry item 14h8dqf written to disk [2023-07-02 19:09:01,792 - bdfr.downloader - DEBUG] - Attempting to download submission 14ger4e [2023-07-02 19:09:01,792 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/cyberpunkred/comments/14ger4e/rent_free_players/ [2023-07-02 19:09:02,051 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/cyberpunkred/WannabeComicReader_Rent Free players!?!_14ger4e.txt [2023-07-02 19:09:02,051 - bdfr.downloader - DEBUG] - Hash added to master list: 962d9d89f2b11b542052ba4eae826d88 [2023-07-02 19:09:02,052 - bdfr.downloader - INFO] - Downloaded submission 14ger4e from cyberpunkred [2023-07-02 19:09:02,052 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 14ger4e [2023-07-02 19:09:02,727 - bdfr.archiver - DEBUG] - Writing entry 14ger4e to file in JSON format at /home/kasia/clonereddit/cyberpunkred/WannabeComicReader_Rent Free players!?!_14ger4e.json [2023-07-02 19:09:02,727 - bdfr.archiver - INFO] - Record for entry item 14ger4e written to disk [2023-07-02 19:09:02,727 - bdfr.downloader - DEBUG] - Attempting to download submission 14dkoih [2023-07-02 19:09:02,727 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/RPGdesign/comments/14dkoih/how_to_make_healingfirst_aid_compelling/ [2023-07-02 19:09:02,967 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/RPGdesign/ItWasInevitable45_How to make healingfirst aid compelling ?_14dkoih.txt [2023-07-02 19:09:02,967 - bdfr.downloader - DEBUG] - Hash added to master list: 30c8f4822598a5bfbaaeda42fb5d1e6e [2023-07-02 19:09:02,968 - bdfr.downloader - INFO] - Downloaded submission 14dkoih from RPGdesign [2023-07-02 19:09:02,968 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 14dkoih [2023-07-02 19:09:03,396 - bdfr.archiver - DEBUG] - Writing entry 14dkoih to file in JSON format at /home/kasia/clonereddit/RPGdesign/ItWasInevitable45_How to make healingfirst aid compelling ?_14dkoih.json [2023-07-02 19:09:03,396 - bdfr.archiver - INFO] - Record for entry item 14dkoih written to disk [2023-07-02 19:09:03,397 - bdfr.downloader - DEBUG] - Attempting to download submission 14cwd24 [2023-07-02 19:09:03,397 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/cyberpunkred/comments/14cwd24/cyberpunk_red_podcast/ [2023-07-02 19:09:03,659 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/cyberpunkred/MemesByJames_Cyberpunk Red Podcast?_14cwd24.txt [2023-07-02 19:09:03,659 - bdfr.downloader - DEBUG] - Hash added to master list: bdb35548f1f317c34cbc5cdc3d1ea980 [2023-07-02 19:09:03,659 - bdfr.downloader - INFO] - Downloaded submission 14cwd24 from cyberpunkred [2023-07-02 19:09:03,659 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 14cwd24 [2023-07-02 19:09:04,183 - bdfr.archiver - DEBUG] - Writing entry 14cwd24 to file in JSON format at /home/kasia/clonereddit/cyberpunkred/MemesByJames_Cyberpunk Red Podcast?_14cwd24.json [2023-07-02 19:09:04,183 - bdfr.archiver - INFO] - Record for entry item 14cwd24 written to disk [2023-07-02 19:09:04,183 - bdfr.downloader - DEBUG] - Attempting to download submission 14cpk3w [2023-07-02 19:09:04,184 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/IsaacArthur/comments/14cpk3w/how_to_have_ships_docking_with_the_rotating_skin/ [2023-07-02 19:09:04,454 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/IsaacArthur/MiamisLastCapitalist_How to have ships docking with the rotating skin of a habitat?_14cpk3w.txt [2023-07-02 19:09:04,456 - bdfr.downloader - DEBUG] - Hash added to master list: 502a1f8fa1ba6343865bb63c43052764 [2023-07-02 19:09:04,456 - bdfr.downloader - INFO] - Downloaded submission 14cpk3w from IsaacArthur [2023-07-02 19:09:04,457 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 14cpk3w [2023-07-02 19:09:05,261 - bdfr.archiver - DEBUG] - Writing entry 14cpk3w to file in JSON format at /home/kasia/clonereddit/IsaacArthur/MiamisLastCapitalist_How to have ships docking with the rotating skin of a habitat?_14cpk3w.json [2023-07-02 19:09:05,261 - bdfr.archiver - INFO] - Record for entry item 14cpk3w written to disk [2023-07-02 19:09:05,261 - bdfr.downloader - DEBUG] - Attempting to download submission 14b10yf [2023-07-02 19:09:06,348 - bdfr.downloader - ERROR] - Could not download submission 14b10yf: No downloader module exists for url https://www.theverge.com/2023/6/16/23763538/reddit-blackout-api-protest-mod-replacement-threat [2023-07-02 19:09:06,348 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 14b10yf [2023-07-02 19:09:07,165 - bdfr.archiver - DEBUG] - Writing entry 14b10yf to file in JSON format at /home/kasia/clonereddit/RedditAlternatives/ardi62_Here’s the note Reddit sent to moderators threatening them if they don’t reopen_14b10yf.json [2023-07-02 19:09:07,165 - bdfr.archiver - INFO] - Record for entry item 14b10yf written to disk [2023-07-02 19:09:07,165 - bdfr.downloader - DEBUG] - Attempting to download submission 149exg5 [2023-07-02 19:09:07,166 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/RPGdesign/comments/149exg5/good_mechanics_to_steal_from_board_games/ [2023-07-02 19:09:07,431 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/RPGdesign/TigrisCallidus_Good mechanics to "steal" from Board Games?_149exg5.txt [2023-07-02 19:09:07,431 - bdfr.downloader - DEBUG] - Hash added to master list: 1ce99917461a4053b2e14ffc5dccd727 [2023-07-02 19:09:07,431 - bdfr.downloader - INFO] - Downloaded submission 149exg5 from RPGdesign [2023-07-02 19:09:07,431 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 149exg5 [2023-07-02 19:09:08,270 - bdfr.archiver - DEBUG] - Writing entry 149exg5 to file in JSON format at /home/kasia/clonereddit/RPGdesign/TigrisCallidus_Good mechanics to "steal" from Board Games?_149exg5.json [2023-07-02 19:09:08,271 - bdfr.archiver - INFO] - Record for entry item 149exg5 written to disk [2023-07-02 19:09:08,271 - bdfr.downloader - DEBUG] - Attempting to download submission 147x906 [2023-07-02 19:09:10,185 - bdfr.site_downloaders.youtube - ERROR] - ERROR: Unsupported URL: https://news.stanford.edu/2023/06/01/mangroves-value/ Traceback (most recent call last): File "/home/kasia/.local/lib/python3.10/site-packages/yt_dlp/YoutubeDL.py", line 1518, in wrapper return func(self, *args, **kwargs) File "/home/kasia/.local/lib/python3.10/site-packages/yt_dlp/YoutubeDL.py", line 1594, in __extract_info ie_result = ie.extract(url) File "/home/kasia/.local/lib/python3.10/site-packages/yt_dlp/extractor/common.py", line 694, in extract ie_result = self._real_extract(url) File "/home/kasia/.local/lib/python3.10/site-packages/yt_dlp/extractor/generic.py", line 2510, in _real_extract raise UnsupportedError(url) yt_dlp.utils.UnsupportedError: Unsupported URL: https://news.stanford.edu/2023/06/01/mangroves-value/

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/home/kasia/.local/lib/python3.10/site-packages/bdfr/site_downloaders/youtube.py", line 73, in get_video_data result = ydl.extract_info(url, download=False) File "/home/kasia/.local/lib/python3.10/site-packages/yt_dlp/YoutubeDL.py", line 1507, in extract_info return self.extract_info(url, self.get_info_extractor(key), download, extra_info, process) File "/home/kasia/.local/lib/python3.10/site-packages/yt_dlp/YoutubeDL.py", line 1518, in wrapper return func(self, *args, **kwargs) File "/home/kasia/.local/lib/python3.10/site-packages/yt_dlp/YoutubeDL.py", line 1615, in extract_info return self.process_ie_result(ie_result, download, extra_info) File "/home/kasia/.local/lib/python3.10/site-packages/yt_dlp/YoutubeDL.py", line 1694, in process_ie_result return self.extract_info( File "/home/kasia/.local/lib/python3.10/site-packages/yt_dlp/YoutubeDL.py", line 1507, in extract_info return self.__extract_info(url, self.get_info_extractor(key), download, extra_info, process) File "/home/kasia/.local/lib/python3.10/site-packages/yt_dlp/YoutubeDL.py", line 1536, in wrapper self.report_error(str(e), e.format_traceback()) File "/home/kasia/.local/lib/python3.10/site-packages/yt_dlp/YoutubeDL.py", line 1015, in report_error self.trouble(f'{self._format_err("ERROR:", self.Styles.ERROR)} {message}', *args, **kwargs) File "/home/kasia/.local/lib/python3.10/site-packages/yt_dlp/YoutubeDL.py", line 955, in trouble raise DownloadError(message, exc_info) yt_dlp.utils.DownloadError: ERROR: Unsupported URL: https://news.stanford.edu/2023/06/01/mangroves-value/ [2023-07-02 19:09:10,190 - bdfr.downloader - ERROR] - Could not download submission 147x906: No downloader module exists for url https://news.stanford.edu/2023/06/01/mangroves-value/ [2023-07-02 19:09:10,190 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 147x906 [2023-07-02 19:09:10,578 - bdfr.archiver - DEBUG] - Writing entry 147x906 to file in JSON format at /home/kasia/clonereddit/environment/Sariel007_A new approach quantifies the value of mangrove forests in Belize for carbon sequestration, tourism, fisheries, and coastal protection, then uses the values to target conservation and restoration._147x906.json [2023-07-02 19:09:10,578 - bdfr.archiver - INFO] - Record for entry item 147x906 written to disk [2023-07-02 19:09:10,579 - bdfr.downloader - DEBUG] - Attempting to download submission 147urul [2023-07-02 19:09:10,580 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/07dj4y1cxm5b1.jpg [2023-07-02 19:09:10,952 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/AlternateHistory/Secsidar_What if?: President Hillary R. Clinton._147urul.jpg [2023-07-02 19:09:10,953 - bdfr.downloader - DEBUG] - Hash added to master list: f3569fc9c8b99b002f65f448e7fa0777 [2023-07-02 19:09:10,953 - bdfr.downloader - INFO] - Downloaded submission 147urul from AlternateHistory [2023-07-02 19:09:10,953 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 147urul [2023-07-02 19:09:13,387 - bdfr.archiver - DEBUG] - Writing entry 147urul to file in JSON format at /home/kasia/clonereddit/AlternateHistory/Secsidar_What if?: President Hillary R. Clinton._147urul.json [2023-07-02 19:09:13,387 - bdfr.archiver - INFO] - Record for entry item 147urul written to disk [2023-07-02 19:09:13,387 - bdfr.downloader - WARNING] - jfzpldz is not a submission [2023-07-02 19:09:14,072 - bdfr.archiver - DEBUG] - Writing entry jfzpldz to file in JSON format at /home/kasia/clonereddit/RPGdesign/Environmental_Fee_64_How does a D100 roll-between mechanic sound for a Fast and Furious style street racing game?_jfzpldz.json [2023-07-02 19:09:14,073 - bdfr.archiver - INFO] - Record for entry item jfzpldz written to disk [2023-07-02 19:09:14,073 - bdfr.downloader - DEBUG] - Attempting to download submission 115ylc8 [2023-07-02 19:09:14,073 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/RPGdesign/comments/115ylc8/rolling_inbetween_two_numbers/ [2023-07-02 19:09:14,325 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/RPGdesign/Winterstorm262_Rolling In-Between Two Numbers_115ylc8.txt [2023-07-02 19:09:14,325 - bdfr.downloader - DEBUG] - Hash added to master list: 2dd096b2e76075a6fa21f443ee534dc7 [2023-07-02 19:09:14,325 - bdfr.downloader - INFO] - Downloaded submission 115ylc8 from RPGdesign [2023-07-02 19:09:14,325 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 115ylc8 [2023-07-02 19:09:14,825 - bdfr.archiver - DEBUG] - Writing entry 115ylc8 to file in JSON format at /home/kasia/clonereddit/RPGdesign/Winterstorm262_Rolling In-Between Two Numbers_115ylc8.json [2023-07-02 19:09:14,828 - bdfr.archiver - INFO] - Record for entry item 115ylc8 written to disk [2023-07-02 19:09:14,828 - bdfr.downloader - DEBUG] - Attempting to download submission 145yhhs [2023-07-02 19:09:14,828 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/RPGdesign/comments/145yhhs/project_v_the_first_draft_of_my_core_resolution/ [2023-07-02 19:09:15,079 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/RPGdesign/willneders_[Project V] The First Draft of My Core Resolution System. Any thoughts on this?_145yhhs.txt [2023-07-02 19:09:15,079 - bdfr.downloader - DEBUG] - Hash added to master list: 5066948ac8bc6cbfa8ef261c4817adbb [2023-07-02 19:09:15,079 - bdfr.downloader - INFO] - Downloaded submission 145yhhs from RPGdesign [2023-07-02 19:09:15,080 - bdfr.archive_entry.submission_archiveentry - DEBUG] - Retrieving full comment tree for submission 145yhhs [2023-07-02 19:09:15,514 - bdfr.archiver - DEBUG] - Writing entry 145yhhs to file in JSON format at /home/kasia/clonereddit/RPGdesign/willneders[Project V] The First Draft of My Core Resolution System. Any thoughts on this?_145yhhs.json [2023-07-02 19:09:15,515 - bdfr.archiver - INFO] - Record for entry item 145yhhs written to disk [2023-07-02 19:09:15,515 - bdfr.downloader - DEBUG] - Attempting to download submission 117f1aa [2023-07-02 19:09:15,516 - bdfr.downloader - DEBUG] - Using Gallery with url https://www.reddit.com/gallery/117f1aa [2023-07-02 19:09:16,119 - bdfr.file_name_formatter - Level 9] - Formatting filename with index 1 [2023-07-02 19:09:16,119 - bdfr.file_name_formatter - Level 9] - Formatting filename with index 2 [2023-07-02 19:09:16,318 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/neography/omerhicaanu_Standard Modern Cuneiform for my semasiographic conlang_117f1aa_1.jpg [2023-07-02 19:09:16,318 - bdfr.downloader - DEBUG] - Hash added to master list: 18d66dfcdb3f0a235020f220942f1368 [2023-07-02 19:09:16,683 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/neography/omerhicaanu_Standard Modern Cuneiform for my semasiographic conlang_117f1aa_2.jpg [2023-07-02 19:09:16,684 - bdfr.downloader - DEBUG] - Hash added to master list: fe2d5fa33ff0cd16ca5a053dec9ef3b6 [2023-07-02 19:09:16,684 - bdfr.downloader - INFO] - Downloaded submission 117f1aa from neography [2023-07-02 19:09:16,684 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 117f1aa [2023-07-02 19:09:17,064 - bdfr.archiver - DEBUG] - Writing entry 117f1aa to file in JSON format at /home/kasia/clonereddit/neography/omerhicaanu_Standard Modern Cuneiform for my semasiographic conlang_117f1aa.json [2023-07-02 19:09:17,065 - bdfr.archiver - INFO] - Record for entry item 117f1aa written to disk [2023-07-02 19:09:17,065 - bdfr.downloader - DEBUG] - Attempting to download submission 1444yvw [2023-07-02 19:09:17,065 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/RPGdesign/comments/1444yvw/a_mechanic_for_resisting_your_characters_virtues/ [2023-07-02 19:09:17,383 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/RPGdesign/Yumoda_A mechanic for resisting your character’s virtues flaws_1444yvw.txt [2023-07-02 19:09:17,384 - bdfr.downloader - DEBUG] - Hash added to master list: 38385473870054126a9e62d5f71bfca6 [2023-07-02 19:09:17,384 - bdfr.downloader - INFO] - Downloaded submission 1444yvw from RPGdesign [2023-07-02 19:09:17,384 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 1444yvw [2023-07-02 19:09:18,026 - bdfr.archiver - DEBUG] - Writing entry 1444yvw to file in JSON format at /home/kasia/clonereddit/RPGdesign/Yumoda_A mechanic for resisting your character’s virtues flaws_1444yvw.json [2023-07-02 19:09:18,026 - bdfr.archiver - INFO] - Record for entry item 1444yvw written to disk [2023-07-02 19:09:18,026 - bdfr.downloader - DEBUG] - Attempting to download submission 1437tlo [2023-07-02 19:09:18,026 - bdfr.downloader - DEBUG] - Using Gallery with url https://www.reddit.com/gallery/1437tlo [2023-07-02 19:09:19,839 - bdfr.file_name_formatter - Level 9] - Formatting filename with index 1 [2023-07-02 19:09:19,840 - bdfr.file_name_formatter - Level 9] - Formatting filename with index 2 [2023-07-02 19:09:19,841 - bdfr.file_name_formatter - Level 9] - Formatting filename with index 3 [2023-07-02 19:09:19,842 - bdfr.file_name_formatter - Level 9] - Formatting filename with index 4 [2023-07-02 19:09:19,842 - bdfr.file_name_formatter - Level 9] - Formatting filename with index 5 [2023-07-02 19:09:20,150 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/cyberpunkred/adayat_Inflitrating the Control Center [1st floor, 2nd floor, roof and floorplan] [10x10]_1437tlo_1.jpg [2023-07-02 19:09:20,150 - bdfr.downloader - DEBUG] - Hash added to master list: 1405981b4ff108ecc374555044fdc6c4 [2023-07-02 19:09:20,454 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/cyberpunkred/adayat_Inflitrating the Control Center [1st floor, 2nd floor, roof and floorplan] [10x10]_1437tlo_2.jpg [2023-07-02 19:09:20,454 - bdfr.downloader - DEBUG] - Hash added to master list: 5ec7f7c0ac31a6e442b4c8c16157bde3 [2023-07-02 19:09:20,774 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/cyberpunkred/adayat_Inflitrating the Control Center [1st floor, 2nd floor, roof and floorplan] [10x10]_1437tlo_3.jpg [2023-07-02 19:09:20,775 - bdfr.downloader - DEBUG] - Hash added to master list: 702e162ecea19a3ab5c6d5092e015217 [2023-07-02 19:09:22,358 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/cyberpunkred/adayat_Inflitrating the Control Center [1st floor, 2nd floor, roof and floorplan] [10x10]_1437tlo_4.jpg [2023-07-02 19:09:22,358 - bdfr.downloader - DEBUG] - Hash added to master list: f93bc02dbfecb7a9e15d321f1e53748c [2023-07-02 19:09:23,688 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/cyberpunkred/adayat_Inflitrating the Control Center [1st floor, 2nd floor, roof and floorplan] [10x10]_1437tlo_5.jpg [2023-07-02 19:09:23,688 - bdfr.downloader - DEBUG] - Hash added to master list: a366c5eeac726cc53967bba5d84c73c0 [2023-07-02 19:09:23,688 - bdfr.downloader - INFO] - Downloaded submission 1437tlo from cyberpunkred [2023-07-02 19:09:23,689 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 1437tlo [2023-07-02 19:09:24,082 - bdfr.archiver - DEBUG] - Writing entry 1437tlo to file in JSON format at /home/kasia/clonereddit/cyberpunkred/adayat_Inflitrating the Control Center [1st floor, 2nd floor, roof and floorplan] [10x10]_1437tlo.json [2023-07-02 19:09:24,083 - bdfr.archiver - INFO] - Record for entry item 1437tlo written to disk [2023-07-02 19:09:24,083 - bdfr.downloader - DEBUG] - Attempting to download submission 142mn61 [2023-07-02 19:09:24,084 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/RPGdesign/comments/142mn61/seeking_assistance_with_crafting_a_crafting_system/ [2023-07-02 19:09:24,359 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/RPGdesign/ShadowRade_Seeking Assistance With Crafting a Crafting System_142mn61.txt [2023-07-02 19:09:24,359 - bdfr.downloader - DEBUG] - Hash added to master list: 17cb33a74de77b6b20bfa29dbe36d2ca [2023-07-02 19:09:24,359 - bdfr.downloader - INFO] - Downloaded submission 142mn61 from RPGdesign [2023-07-02 19:09:24,360 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 142mn61 [2023-07-02 19:09:24,798 - bdfr.archiver - DEBUG] - Writing entry 142mn61 to file in JSON format at /home/kasia/clonereddit/RPGdesign/ShadowRade_Seeking Assistance With Crafting a Crafting System_142mn61.json [2023-07-02 19:09:24,799 - bdfr.archiver - INFO] - Record for entry item 142mn61 written to disk [2023-07-02 19:09:24,799 - bdfr.downloader - DEBUG] - Attempting to download submission 143b31x [2023-07-02 19:09:24,800 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/rpg/comments/143b31x/thoughts_on_dice_pools/ [2023-07-02 19:09:25,062 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/rpg/InkBladePublishing_Thoughts on Dice Pools?_143b31x.txt [2023-07-02 19:09:25,063 - bdfr.downloader - DEBUG] - Hash added to master list: 355a684eff60eef948bdf1a75305b61f [2023-07-02 19:09:25,063 - bdfr.downloader - INFO] - Downloaded submission 143b31x from rpg [2023-07-02 19:09:25,063 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 143b31x [2023-07-02 19:09:25,800 - bdfr.archiver - DEBUG] - Writing entry 143b31x to file in JSON format at /home/kasia/clonereddit/rpg/InkBladePublishing_Thoughts on Dice Pools?_143b31x.json [2023-07-02 19:09:25,800 - bdfr.archiver - INFO] - Record for entry item 143b31x written to disk [2023-07-02 19:09:25,801 - bdfr.downloader - DEBUG] - Attempting to download submission 142o2vr [2023-07-02 19:09:25,801 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/cyberpunkred/comments/142o2vr/help_with_making_corpos_hateable/ [2023-07-02 19:09:26,078 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/cyberpunkred/RU5TR3D_Help with making corpos hateable?_142o2vr.txt [2023-07-02 19:09:26,078 - bdfr.downloader - DEBUG] - Hash added to master list: ef82ba46a9becfc63a301edd1ef89956 [2023-07-02 19:09:26,078 - bdfr.downloader - INFO] - Downloaded submission 142o2vr from cyberpunkred [2023-07-02 19:09:26,078 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 142o2vr [2023-07-02 19:09:27,053 - bdfr.archiver - DEBUG] - Writing entry 142o2vr to file in JSON format at /home/kasia/clonereddit/cyberpunkred/RU5TR3D_Help with making corpos hateable?_142o2vr.json [2023-07-02 19:09:27,053 - bdfr.archiver - INFO] - Record for entry item 142o2vr written to disk [2023-07-02 19:09:27,053 - bdfr.downloader - DEBUG] - Attempting to download submission 142kyu7 [2023-07-02 19:09:27,053 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/cyberpunkred/comments/142kyu7/i_made_a_personality_database_list_for_my_campaign/ [2023-07-02 19:09:27,299 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/cyberpunkred/atomicpunk88_I made a personality database list for my campaign!_142kyu7.txt [2023-07-02 19:09:27,299 - bdfr.downloader - DEBUG] - Hash added to master list: 0e373650d291561978546191948fdd03 [2023-07-02 19:09:27,299 - bdfr.downloader - INFO] - Downloaded submission 142kyu7 from cyberpunkred [2023-07-02 19:09:27,299 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 142kyu7 [2023-07-02 19:09:27,597 - bdfr.archiver - DEBUG] - Writing entry 142kyu7 to file in JSON format at /home/kasia/clonereddit/cyberpunkred/atomicpunk88_I made a personality database list for my campaign!_142kyu7.json [2023-07-02 19:09:27,597 - bdfr.archiver - INFO] - Record for entry item 142kyu7 written to disk [2023-07-02 19:09:27,597 - bdfr.downloader - DEBUG] - Attempting to download submission 141vl8i [2023-07-02 19:09:27,597 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/dndnext/comments/141vl8i/how_have_you_made_mind_flayers_actually_scary_in/ [2023-07-02 19:09:27,856 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/dndnext/Neongelion_How have you made mind flayers actually scary in your games?_141vl8i.txt [2023-07-02 19:09:27,857 - bdfr.downloader - DEBUG] - Hash added to master list: 6794e0561425ba52ce502e0967277cad [2023-07-02 19:09:27,857 - bdfr.downloader - INFO] - Downloaded submission 141vl8i from dndnext [2023-07-02 19:09:27,857 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 141vl8i [2023-07-02 19:09:29,080 - bdfr.archiver - DEBUG] - Writing entry 141vl8i to file in JSON format at /home/kasia/clonereddit/dndnext/Neongelion_How have you made mind flayers actually scary in your games?_141vl8i.json [2023-07-02 19:09:29,080 - bdfr.archiver - INFO] - Record for entry item 141vl8i written to disk [2023-07-02 19:09:29,080 - bdfr.downloader - DEBUG] - Attempting to download submission 140op9g [2023-07-02 19:09:29,081 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/gurps/comments/140op9g/is_there_a_narrative_version_of_gurps/ [2023-07-02 19:09:29,332 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/gurps/Ananiujitha_Is There a Narrative Version of GURPS?_140op9g.txt [2023-07-02 19:09:29,332 - bdfr.downloader - DEBUG] - Hash added to master list: 234e15a04a3ce1ad37148f9ec48b3e2c [2023-07-02 19:09:29,332 - bdfr.downloader - INFO] - Downloaded submission 140op9g from gurps [2023-07-02 19:09:29,332 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 140op9g [2023-07-02 19:09:29,958 - bdfr.archiver - DEBUG] - Writing entry 140op9g to file in JSON format at /home/kasia/clonereddit/gurps/Ananiujitha_Is There a Narrative Version of GURPS?_140op9g.json [2023-07-02 19:09:29,959 - bdfr.archiver - INFO] - Record for entry item 140op9g written to disk [2023-07-02 19:09:29,959 - bdfr.downloader - DEBUG] - Attempting to download submission 13zomtd [2023-07-02 19:09:29,959 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/RPGdesign/comments/13zomtd/can_pendragons_blackjack_style_roll_resolution/ [2023-07-02 19:09:30,244 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/RPGdesign/Kubsterrb17_Can Pendragon's black-jack style roll resolution mechanic be improved in any way?_13zomtd.txt [2023-07-02 19:09:30,246 - bdfr.downloader - DEBUG] - Hash added to master list: 30a89f22cb820e5ff2a37d708df53c58 [2023-07-02 19:09:30,246 - bdfr.downloader - INFO] - Downloaded submission 13zomtd from RPGdesign [2023-07-02 19:09:30,246 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 13zomtd [2023-07-02 19:09:31,143 - bdfr.archiver - DEBUG] - Writing entry 13zomtd to file in JSON format at /home/kasia/clonereddit/RPGdesign/Kubsterrb17_Can Pendragon's black-jack style roll resolution mechanic be improved in any way?_13zomtd.json [2023-07-02 19:09:31,144 - bdfr.archiver - INFO] - Record for entry item 13zomtd written to disk [2023-07-02 19:09:31,144 - root - INFO] - Program complete

Zireael07 commented 1 year ago

Seriously, bdfr executable should say (or have a readme next to executable) where the logs are stored instead of the user having to scroll through a very long readme on the repo to find out

Serene-Arc commented 1 year ago

That's why Ctrl+f was invented. Thank you, I'll see if I can fix this bug.

jkexbx commented 1 year ago

I can confirm it's definitely from saved comments. I have a lot more and it skips them every time with "is not a submission"