Open JoeyJFranklin opened 1 year ago
Can you see if it's working with a single ID? Take one of the IDs from that file, such as 15s0kx1
and then use -l 15s0kx1
instead of -s photographs
to confirm that the submissions really are being downloaded when they're actually excluded.
I used this command, using a new file successful1 with just that ID in it
bdfr download H:\programs\bdfr -l 15s0kx1 --exclude-id-file successful1.txt
and this is the log output
[2023-08-16 13:32:25,178 - bdfr.connector - DEBUG] - Disabling the following modules:
[2023-08-16 13:32:25,178 - bdfr.connector - Level 9] - Created download filter
[2023-08-16 13:32:25,178 - bdfr.connector - Level 9] - Created time filter
[2023-08-16 13:32:25,179 - bdfr.connector - Level 9] - Created sort filter
[2023-08-16 13:32:25,254 - bdfr.connector - Level 9] - Create file name formatter
[2023-08-16 13:32:25,255 - bdfr.connector - DEBUG] - Using unauthenticated Reddit instance
[2023-08-16 13:32:25,257 - bdfr.connector - Level 9] - Created site authenticator
[2023-08-16 13:32:25,258 - bdfr.connector - Level 9] - Retrieved subreddits
[2023-08-16 13:32:25,258 - bdfr.connector - Level 9] - Retrieved multireddits
[2023-08-16 13:32:25,258 - bdfr.connector - Level 9] - Retrieved user data
[2023-08-16 13:32:25,259 - bdfr.connector - Level 9] - Retrieved submissions for given links
[2023-08-16 13:32:26,363 - bdfr.downloader - DEBUG] - Attempting to download submission 15s0kx1
[2023-08-16 13:32:26,365 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/n18v7ydehbib1.jpg
[2023-08-16 13:32:27,835 - bdfr.downloader - DEBUG] - Written file to H:\programs\bdfr\photographs\0x3Alex_Sleepy Monkey_15s0kx1.jpg
[2023-08-16 13:32:27,836 - bdfr.downloader - DEBUG] - Hash added to master list: d8f7a229006994afcdd37fcaaf4847f5
[2023-08-16 13:32:27,837 - bdfr.downloader - INFO] - Downloaded submission 15s0kx1 from photographs
[2023-08-16 13:32:27,838 - root - INFO] - Program complete
Can you try installing the latest version from development and see if the problem persists?
No idea how to do that.
Nevermind figured it out. Running the same command as before this is the new log output
[2023-08-17 07:11:02,332 - bdfr.connector - DEBUG] - Disabling the following modules:
[2023-08-17 07:11:02,332 - bdfr.connector - Level 9] - Created download filter
[2023-08-17 07:11:02,333 - bdfr.connector - Level 9] - Created time filter
[2023-08-17 07:11:02,333 - bdfr.connector - Level 9] - Created sort filter
[2023-08-17 07:11:02,408 - bdfr.connector - Level 9] - Create file name formatter
[2023-08-17 07:11:02,434 - bdfr.connector - DEBUG] - Using unauthenticated Reddit instance
[2023-08-17 07:11:02,435 - bdfr.connector - WARNING] - Using an unauthenticated app like this will result in Reddit limiting queries to 10 requests a minute
[2023-08-17 07:11:02,440 - bdfr.connector - Level 9] - Created site authenticator
[2023-08-17 07:11:02,440 - bdfr.connector - Level 9] - Retrieved subreddits
[2023-08-17 07:11:02,440 - bdfr.connector - Level 9] - Retrieved multireddits
[2023-08-17 07:11:02,441 - bdfr.connector - Level 9] - Retrieved user data
[2023-08-17 07:11:02,441 - bdfr.connector - Level 9] - Retrieved submissions for given links
[2023-08-17 07:11:03,755 - bdfr.downloader - DEBUG] - Attempting to download submission 15s0kx1
[2023-08-17 07:11:03,757 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/n18v7ydehbib1.jpg
[2023-08-17 07:11:05,330 - bdfr.downloader - DEBUG] - Written file to H:\programs\bdfr\photographs\0x3Alex_Sleepy Monkey_15s0kx1.jpg
[2023-08-17 07:11:05,331 - bdfr.downloader - DEBUG] - Hash added to master list: d8f7a229006994afcdd37fcaaf4847f5
[2023-08-17 07:11:05,331 - bdfr.downloader - INFO] - Downloaded submission 15s0kx1 from photographs
[2023-08-17 07:11:05,332 - root - INFO] - Program complete - BDFR Downloader v2.7.0
Description
I don't think that --exclude-id-file is working, files still get downloaded
Command
Environment (please complete the following information)
Logs
If the files already exist in the directory then the log looks like this
If the file does not exist already the log looks like this
Extra
This is the list of files in the directory showing that the successful.txt file does exist
and this is a snip of successful.txt showing the IDs