[BUG] PRAW Error Code 429

GarethFreeman commented 1 year ago

[x] I am reporting a bug.
[x] I am running the latest version of BDfR
[x] I have read the Opening an issue

Description

I am trying to rip a reddit user's submitted posts but keep getting blocked by PRAW, I've also tried updating with no success. It does work sometimes but it much slower than usual.

Command

py -3 -m bdfr download C:\bdfrips\tti --user TameTheseImpalas --submitted

Environment (please complete the following information)

OS: Windows 10
Python version: 3.10

Logs

py -3 -m bdfr download C:\bdfrips\tti --user TameTheseImpalas --submitted [2023-07-11 19:55:00,020 - bdfr.connector - ERROR] - User TameTheseImpalas failed to be retrieved due to a PRAW exception: received 429 HTTP response

Serene-Arc commented 1 year ago

Please supply the logs. They are not optional

KylarZeppeli commented 1 year ago

I got this error as well while downloading a certain subreddit. The program quit prematurely right after it showed the error. Strangely, I didn't get the 6 minute delay on this one but got the 429 error instead.

Command I used: bdfr-download . -s "traps" Here's my log for the above command: [2023-07-12 12:39:58,479 - bdfr.connector - DEBUG] - Disabling the following modules: [2023-07-12 12:39:58,479 - bdfr.connector - Level 9] - Created download filter [2023-07-12 12:39:58,479 - bdfr.connector - Level 9] - Created time filter [2023-07-12 12:39:58,479 - bdfr.connector - Level 9] - Created sort filter [2023-07-12 12:39:58,480 - bdfr.connector - Level 9] - Create file name formatter [2023-07-12 12:39:58,481 - bdfr.connector - DEBUG] - Using unauthenticated Reddit instance [2023-07-12 12:39:58,481 - bdfr.connector - Level 9] - Created site authenticator [2023-07-12 12:39:58,969 - bdfr.connector - DEBUG] - Added submissions from subreddit traps [2023-07-12 12:39:58,969 - bdfr.connector - Level 9] - Retrieved subreddits [2023-07-12 12:39:58,969 - bdfr.connector - Level 9] - Retrieved multireddits [2023-07-12 12:39:58,969 - bdfr.connector - Level 9] - Retrieved user data [2023-07-12 12:39:58,969 - bdfr.connector - Level 9] - Retrieved submissions for given links [2023-07-12 12:40:10,419 - bdfr.downloader - DEBUG] - Attempting to download submission f7kopk [2023-07-12 12:40:10,420 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/traps/comments/f7kopk/hello_and_welcome_please_read_our_rules_before/ [2023-07-12 12:40:20,552 - bdfr.downloader - DEBUG] - File /tmp/traps/DELETED_Hello and welcome. Please READ OUR RULES before posting. Discord link is in the sidebar and in this post. If your post does not appear contact mods!_f7kopk.txt from submission f7kopk already exists, continuing [2023-07-12 12:40:20,552 - bdfr.downloader - INFO] - Downloaded submission f7kopk from traps [2023-07-12 12:40:20,552 - bdfr.downloader - DEBUG] - Attempting to download submission 14xsnsd [2023-07-12 12:40:20,552 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/traps/comments/14xsnsd/modmail_replies_are_delayed_just_an_fyi/ [2023-07-12 12:40:30,686 - bdfr.downloader - DEBUG] - File /tmp/traps/wills731_Modmail replies are delayed. Just an FYI_14xsnsd.txt from submission 14xsnsd already exists, continuing [2023-07-12 12:40:30,686 - bdfr.downloader - INFO] - Downloaded submission 14xsnsd from traps [2023-07-12 12:40:30,686 - bdfr.downloader - DEBUG] - Attempting to download submission 14xlm9w [2023-07-12 12:40:30,686 - bdfr.downloader - DEBUG] - Using Redgifs with url https://v3.redgifs.com/watch/gorgeousruddyvenomoussnake [2023-07-12 12:40:31,302 - bdfr.downloader - DEBUG] - File /tmp/traps/vanillalindsay_Are you pulling out or cumming inside on the first date? 😋_14xlm9w.mp4 from submission 14xlm9w already exists, continuing [2023-07-12 12:40:31,302 - bdfr.downloader - INFO] - Downloaded submission 14xlm9w from traps [2023-07-12 12:40:31,303 - bdfr.downloader - DEBUG] - Attempting to download submission 14xm6vy [2023-07-12 12:40:31,303 - bdfr.downloader - DEBUG] - Using Imgur with url https://i.imgur.com/5qjDMa5.gifv [2023-07-12 12:40:31,496 - bdfr.downloader - ERROR] - Site Imgur failed to download submission 14xm6vy: Server responded with 404 at https://api.imgur.com/3/image/5qjDMa5 [2023-07-12 12:40:31,497 - bdfr.downloader - DEBUG] - Attempting to download submission 14xr2wn [2023-07-12 12:40:31,498 - bdfr.downloader - DEBUG] - Using Imgur with url https://i.imgur.com/1bJU9sb.gifv [2023-07-12 12:40:31,922 - bdfr.downloader - ERROR] - Site Imgur failed to download submission 14xr2wn: Server responded with 404 at https://api.imgur.com/3/image/1bJU9sb [2023-07-12 12:40:31,923 - bdfr.downloader - DEBUG] - Attempting to download submission 14xjurx [2023-07-12 12:40:31,923 - bdfr.downloader - DEBUG] - Using Imgur with url https://i.imgur.com/6BKnnHt.gifv [2023-07-12 12:40:32,112 - bdfr.downloader - ERROR] - Site Imgur failed to download submission 14xjurx: Server responded with 404 at https://api.imgur.com/3/image/6BKnnHt [2023-07-12 12:40:32,113 - bdfr.downloader - DEBUG] - Attempting to download submission 14xl0pt [2023-07-12 12:40:32,114 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/409vm12lkibb1.jpg [2023-07-12 12:40:32,114 - bdfr.downloader - DEBUG] - File /tmp/traps/taylahg24_What do you think of redheads? 🥰_14xl0pt.jpg from submission 14xl0pt already exists, continuing [2023-07-12 12:40:32,114 - bdfr.downloader - INFO] - Downloaded submission 14xl0pt from traps [2023-07-12 12:40:32,114 - bdfr.downloader - DEBUG] - Attempting to download submission 14xpug3 [2023-07-12 12:40:32,114 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/xnp7069hhibb1.gif [2023-07-12 12:40:32,114 - bdfr.downloader - DEBUG] - File /tmp/traps/JaybaesunOC_Me and who?_14xpug3.gif from submission 14xpug3 already exists, continuing [2023-07-12 12:40:32,114 - bdfr.downloader - INFO] - Downloaded submission 14xpug3 from traps [2023-07-12 12:40:32,114 - bdfr.downloader - DEBUG] - Attempting to download submission 14xil8u [2023-07-12 12:40:32,114 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/fljdftiqyhbb1.jpg [2023-07-12 12:40:32,115 - bdfr.downloader - DEBUG] - File /tmp/traps/Saskia_and_Sasha_Wanna come play in our secret garden? 😏 You can play with us, if we can play with you 😈_14xil8u.jpg from submission 14xil8u already exists, continuing [2023-07-12 12:40:32,115 - bdfr.downloader - INFO] - Downloaded submission 14xil8u from traps [2023-07-12 12:40:32,115 - bdfr.downloader - DEBUG] - Attempting to download submission 14x2mck [2023-07-12 12:40:32,115 - bdfr.downloader - DEBUG] - Using Redgifs with url https://v3.redgifs.com/watch/lametrueambushbug [2023-07-12 12:40:32,443 - bdfr.downloader - DEBUG] - File /tmp/traps/jessaPinkgirl_would you cum inside me? be honest 😏_14x2mck.mp4 from submission 14x2mck already exists, continuing [2023-07-12 12:40:32,443 - bdfr.downloader - INFO] - Downloaded submission 14x2mck from traps [2023-07-12 12:40:32,443 - bdfr.downloader - DEBUG] - Attempting to download submission 14xhsjn [2023-07-12 12:40:32,443 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/97kv8zvvqhbb1.jpg [2023-07-12 12:40:32,444 - bdfr.downloader - DEBUG] - File /tmp/traps/ov-ary_say hi if you’d cum inside me 😉_14xhsjn.jpg from submission 14xhsjn already exists, continuing [2023-07-12 12:40:32,444 - bdfr.downloader - INFO] - Downloaded submission 14xhsjn from traps [2023-07-12 12:40:32,444 - bdfr.downloader - DEBUG] - Attempting to download submission 14x0z31 [2023-07-12 12:40:32,444 - bdfr.downloader - DEBUG] - Using Imgur with url https://i.imgur.com/wKmOtVz.gifv [2023-07-12 12:40:32,657 - bdfr.downloader - ERROR] - Site Imgur failed to download submission 14x0z31: Server responded with 404 at https://api.imgur.com/3/image/wKmOtVz [2023-07-12 12:40:32,658 - bdfr.downloader - DEBUG] - Attempting to download submission 14x1wd8 [2023-07-12 12:40:32,658 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/zqm52op87ebb1.gif [2023-07-12 12:40:32,658 - bdfr.downloader - DEBUG] - File /tmp/traps/MyMyMarceline_Say hi if you’d still fuck a trans girl even if she’s chubby 😳🖤_14x1wd8.gif from submission 14x1wd8 already exists, continuing [2023-07-12 12:40:32,659 - bdfr.downloader - INFO] - Downloaded submission 14x1wd8 from traps [2023-07-12 12:40:32,659 - bdfr.downloader - DEBUG] - Attempting to download submission 14x0855 [2023-07-12 12:40:32,659 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/3qs22nt2wdbb1.jpg [2023-07-12 12:40:32,659 - bdfr.downloader - DEBUG] - File /tmp/traps/vasyaroe_hii can i send you a dick pic 🫣💕_14x0855.jpg from submission 14x0855 already exists, continuing [2023-07-12 12:40:32,659 - bdfr.downloader - INFO] - Downloaded submission 14x0855 from traps [2023-07-12 12:40:32,659 - bdfr.downloader - DEBUG] - Attempting to download submission 14xro70 [2023-07-12 12:40:32,659 - bdfr.downloader - DEBUG] - Using Redgifs with url https://i.redgifs.com/i/muddychubbyandalusianhorse.jpg [2023-07-12 12:40:32,846 - bdfr.downloader - DEBUG] - File /tmp/traps/AlsoAshley_Getting out more this year has been fun... Maybe you can ask me out if you see me 😜_14xro70.jpg from submission 14xro70 already exists, continuing [2023-07-12 12:40:32,846 - bdfr.downloader - INFO] - Downloaded submission 14xro70 from traps [2023-07-12 12:40:32,846 - bdfr.downloader - DEBUG] - Attempting to download submission 14x21nu [2023-07-12 12:40:32,846 - bdfr.downloader - DEBUG] - Using Imgur with url https://i.imgur.com/zR5gOD9.gifv [2023-07-12 12:40:33,052 - bdfr.downloader - ERROR] - Site Imgur failed to download submission 14x21nu: Server responded with 404 at https://api.imgur.com/3/image/zR5gOD9 [2023-07-12 12:40:33,053 - bdfr.downloader - DEBUG] - Attempting to download submission 14xrc3q [2023-07-12 12:40:33,054 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/k7arkq32wjbb1.jpg [2023-07-12 12:40:33,054 - bdfr.downloader - DEBUG] - File /tmp/traps/genderflipflops_smash or pass? :)_14xrc3q.jpg from submission 14xrc3q already exists, continuing [2023-07-12 12:40:33,054 - bdfr.downloader - INFO] - Downloaded submission 14xrc3q from traps [2023-07-12 12:40:33,054 - bdfr.downloader - DEBUG] - Attempting to download submission 14x9ki3 [2023-07-12 12:40:33,054 - bdfr.downloader - DEBUG] - Using Imgur with url https://i.imgur.com/zCtwTVb.gifv [2023-07-12 12:40:33,243 - bdfr.downloader - ERROR] - Site Imgur failed to download submission 14x9ki3: Server responded with 404 at https://api.imgur.com/3/image/zCtwTVb [2023-07-12 12:40:33,244 - bdfr.downloader - DEBUG] - Attempting to download submission 14xs82g [2023-07-12 12:40:33,244 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/qfw68c6x1kbb1.jpg [2023-07-12 12:40:33,244 - bdfr.downloader - DEBUG] - File /tmp/traps/muasshole_Do you like my ‘something extra’ ?_14xs82g.jpg from submission 14xs82g already exists, continuing [2023-07-12 12:40:33,244 - bdfr.downloader - INFO] - Downloaded submission 14xs82g from traps [2023-07-12 12:40:33,244 - bdfr.downloader - DEBUG] - Attempting to download submission 14xmhgm [2023-07-12 12:40:33,245 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/89j4g7ttwibb1.jpg [2023-07-12 12:40:33,245 - bdfr.downloader - DEBUG] - File /tmp/traps/itslexieNL_Can I sit on your lap? 🥵🔥_14xmhgm.jpg from submission 14xmhgm already exists, continuing [2023-07-12 12:40:33,245 - bdfr.downloader - INFO] - Downloaded submission 14xmhgm from traps [2023-07-12 12:40:33,245 - bdfr.downloader - DEBUG] - Attempting to download submission 14x4vry [2023-07-12 12:40:33,245 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/rsc7hmp0rebb1.jpg [2023-07-12 12:40:33,245 - bdfr.downloader - DEBUG] - File /tmp/traps/my-secret-gf_Say hi if u wanna put ur dick inside me! ✌️_14x4vry.jpg from submission 14x4vry already exists, continuing [2023-07-12 12:40:33,245 - bdfr.downloader - INFO] - Downloaded submission 14x4vry from traps [2023-07-12 12:40:33,245 - bdfr.downloader - DEBUG] - Attempting to download submission 14xi2hi [2023-07-12 12:40:33,245 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/rzujzivlthbb1.jpg [2023-07-12 12:40:33,246 - bdfr.downloader - DEBUG] - File /tmp/traps/iammery_Fuck, marry or breed? 😝_14xi2hi.jpg from submission 14xi2hi already exists, continuing [2023-07-12 12:40:33,246 - bdfr.downloader - INFO] - Downloaded submission 14xi2hi from traps [2023-07-12 12:40:33,246 - bdfr.downloader - DEBUG] - Attempting to download submission 14xp0qo [2023-07-12 12:40:33,246 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/dq1108d6gjbb1.gif [2023-07-12 12:40:33,246 - bdfr.downloader - DEBUG] - File /tmp/traps/MinkaSummers_Do you want this in your mouth straight boy? Be honest!_14xp0qo.gif from submission 14xp0qo already exists, continuing [2023-07-12 12:40:33,246 - bdfr.downloader - INFO] - Downloaded submission 14xp0qo from traps [2023-07-12 12:40:33,246 - bdfr.downloader - DEBUG] - Attempting to download submission 14xo5ua [2023-07-12 12:40:33,247 - bdfr.downloader - DEBUG] - Using Redgifs with url https://www.redgifs.com/watch/vigilanthandsomeafricanfisheagle [2023-07-12 12:40:33,572 - bdfr.downloader - DEBUG] - File /tmp/traps/anoblirigj_Did you stop scrolling now?_14xo5ua.mp4 from submission 14xo5ua already exists, continuing [2023-07-12 12:40:33,572 - bdfr.downloader - INFO] - Downloaded submission 14xo5ua from traps [2023-07-12 12:40:33,572 - bdfr.downloader - DEBUG] - Attempting to download submission 14xuuu2 [2023-07-12 12:40:33,572 - bdfr.downloader - DEBUG] - Using Imgur with url https://i.imgur.com/uKuHbVp.gifv [2023-07-12 12:40:33,796 - bdfr.downloader - ERROR] - Site Imgur failed to download submission 14xuuu2: Server responded with 404 at https://api.imgur.com/3/image/uKuHbVp [2023-07-12 12:40:33,797 - bdfr.downloader - DEBUG] - Attempting to download submission 14xsexs [2023-07-12 12:40:33,797 - bdfr.downloader - DEBUG] - Using Redgifs with url https://www.redgifs.com/watch/superbunsungindri [2023-07-12 12:40:34,134 - bdfr.downloader - DEBUG] - File /tmp/traps/Ecstatic-Start-9245_Spit or swallow?_14xsexs.mp4 from submission 14xsexs already exists, continuing [2023-07-12 12:40:34,134 - bdfr.downloader - INFO] - Downloaded submission 14xsexs from traps [2023-07-12 12:40:34,134 - bdfr.downloader - DEBUG] - Attempting to download submission 14xa9cm [2023-07-12 12:40:34,134 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/tvkbwlh7vfbb1.jpg [2023-07-12 12:40:34,134 - bdfr.downloader - DEBUG] - File /tmp/traps/MichelleAlter_I don’t think my bikini is big enough_14xa9cm.jpg from submission 14xa9cm already exists, continuing [2023-07-12 12:40:34,135 - bdfr.downloader - INFO] - Downloaded submission 14xa9cm from traps [2023-07-12 12:40:34,135 - bdfr.downloader - DEBUG] - Attempting to download submission 14xt3f4 [2023-07-12 12:40:34,135 - bdfr.downloader - DEBUG] - Using Redgifs with url https://www.redgifs.com/watch/pungentfunctionalhadrosaurus [2023-07-12 12:40:34,477 - bdfr.downloader - DEBUG] - File /tmp/traps/jordxdollx_Wanna fuck my tight t-girl ass?_14xt3f4.mp4 from submission 14xt3f4 already exists, continuing [2023-07-12 12:40:34,477 - bdfr.downloader - INFO] - Downloaded submission 14xt3f4 from traps [2023-07-12 12:40:34,477 - bdfr.downloader - DEBUG] - Attempting to download submission 14xr170 [2023-07-12 12:40:34,477 - bdfr.downloader - DEBUG] - Using Redgifs with url https://www.redgifs.com/watch/tanopaqueloris [2023-07-12 12:40:35,303 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/PartTime_Femboy_If you see this growing under my dress, what’s your next move?👀_14xr170.mp4 [2023-07-12 12:40:35,303 - bdfr.downloader - DEBUG] - Hash added to master list: 984aa4fb156c7378dadae3d121811a7b [2023-07-12 12:40:35,303 - bdfr.downloader - INFO] - Downloaded submission 14xr170 from traps [2023-07-12 12:40:35,303 - bdfr.downloader - DEBUG] - Attempting to download submission 14xrv3e [2023-07-12 12:40:35,303 - bdfr.downloader - DEBUG] - Using Imgur with url https://i.imgur.com/our8l09.gifv [2023-07-12 12:40:35,652 - bdfr.downloader - ERROR] - Site Imgur failed to download submission 14xrv3e: Server responded with 404 at https://api.imgur.com/3/image/our8l09 [2023-07-12 12:40:35,653 - bdfr.downloader - DEBUG] - Attempting to download submission 14xt5d2 [2023-07-12 12:40:35,654 - bdfr.downloader - DEBUG] - Using Redgifs with url https://www.redgifs.com/watch/mysteriousleangartersnake [2023-07-12 12:40:36,530 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/Quick-Play_Femboy_Let me Cum on your face💕_14xt5d2.mp4 [2023-07-12 12:40:36,531 - bdfr.downloader - DEBUG] - Hash added to master list: 0809a054a64c19a88bf1bd42592722e1 [2023-07-12 12:40:36,531 - bdfr.downloader - INFO] - Downloaded submission 14xt5d2 from traps [2023-07-12 12:40:36,531 - bdfr.downloader - DEBUG] - Attempting to download submission 14xosim [2023-07-12 12:40:36,531 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/fzads4ugejbb1.jpg [2023-07-12 12:40:36,531 - bdfr.downloader - DEBUG] - File /tmp/traps/MaxHamster69_any straight guys want to play with my dick? 💕_14xosim.jpg from submission 14xosim already exists, continuing [2023-07-12 12:40:36,531 - bdfr.downloader - INFO] - Downloaded submission 14xosim from traps [2023-07-12 12:40:36,531 - bdfr.downloader - DEBUG] - Attempting to download submission 14x44gi [2023-07-12 12:40:36,531 - bdfr.downloader - DEBUG] - Using Imgur with url https://i.imgur.com/WfmqQlm.gifv [2023-07-12 12:40:36,863 - bdfr.downloader - ERROR] - Site Imgur failed to download submission 14x44gi: Server responded with 404 at https://api.imgur.com/3/image/WfmqQlm [2023-07-12 12:40:36,864 - bdfr.downloader - DEBUG] - Attempting to download submission 14xobzr [2023-07-12 12:40:36,864 - bdfr.downloader - DEBUG] - Using Redgifs with url https://www.redgifs.com/watch/notedinsignificantfly [2023-07-12 12:40:37,227 - bdfr.downloader - DEBUG] - File /tmp/traps/nicolexhunt_Can I trap you with my big eyes? 🥹😌_14xobzr.mp4 from submission 14xobzr already exists, continuing [2023-07-12 12:40:37,228 - bdfr.downloader - INFO] - Downloaded submission 14xobzr from traps [2023-07-12 12:40:37,228 - bdfr.downloader - DEBUG] - Attempting to download submission 14xpffg [2023-07-12 12:40:37,228 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/0x011yj2jjbb1.gif [2023-07-12 12:40:37,228 - bdfr.downloader - DEBUG] - File /tmp/traps/tsjianna_Would you stick your dick inside?_14xpffg.gif from submission 14xpffg already exists, continuing [2023-07-12 12:40:37,228 - bdfr.downloader - INFO] - Downloaded submission 14xpffg from traps [2023-07-12 12:40:37,228 - bdfr.downloader - DEBUG] - Attempting to download submission 14xhr3k [2023-07-12 12:40:37,228 - bdfr.downloader - DEBUG] - Using Gallery with url https://www.reddit.com/gallery/14xhr3k [2023-07-12 12:40:37,558 - bdfr.file_name_formatter - Level 9] - Formatting filename with index 1 [2023-07-12 12:40:37,558 - bdfr.file_name_formatter - Level 9] - Formatting filename with index 2 [2023-07-12 12:40:37,559 - bdfr.downloader - DEBUG] - File /tmp/traps/eevie_chan_If you only had to choose one, front or back?_14xhr3k_1.jpg from submission 14xhr3k already exists, continuing [2023-07-12 12:40:37,559 - bdfr.downloader - DEBUG] - File /tmp/traps/eevie_chan_If you only had to choose one, front or back?_14xhr3k_2.jpg from submission 14xhr3k already exists, continuing [2023-07-12 12:40:37,559 - bdfr.downloader - INFO] - Downloaded submission 14xhr3k from traps [2023-07-12 12:40:37,559 - bdfr.downloader - DEBUG] - Attempting to download submission 14x6muz [2023-07-12 12:40:37,559 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/s183oc9a3fbb1.jpg [2023-07-12 12:40:37,559 - bdfr.downloader - DEBUG] - File /tmp/traps/tsaliyahh_Do we have time to play with the whip … or should we just get to business? 😈_14x6muz.jpg from submission 14x6muz already exists, continuing [2023-07-12 12:40:37,559 - bdfr.downloader - INFO] - Downloaded submission 14x6muz from traps [2023-07-12 12:40:37,559 - bdfr.downloader - DEBUG] - Attempting to download submission 14xdmqd [2023-07-12 12:40:37,559 - bdfr.downloader - DEBUG] - Using Redgifs with url https://www.redgifs.com/watch/warmheartedbrownbrahmanbull [2023-07-12 12:40:37,906 - bdfr.downloader - DEBUG] - File /tmp/traps/pierbi_say hi if you like what im been hiding 😳_14xdmqd.mp4 from submission 14xdmqd already exists, continuing [2023-07-12 12:40:37,906 - bdfr.downloader - INFO] - Downloaded submission 14xdmqd from traps [2023-07-12 12:40:37,906 - bdfr.downloader - DEBUG] - Attempting to download submission 14xmri2 [2023-07-12 12:40:37,907 - bdfr.downloader - DEBUG] - Using Redgifs with url https://i.redgifs.com/i/strictemptyglowworm.jpg [2023-07-12 12:40:38,091 - bdfr.downloader - DEBUG] - File /tmp/traps/cheshirekitten11_It is an invitation~_14xmri2.jpg from submission 14xmri2 already exists, continuing [2023-07-12 12:40:38,091 - bdfr.downloader - INFO] - Downloaded submission 14xmri2 from traps [2023-07-12 12:40:38,091 - bdfr.downloader - DEBUG] - Attempting to download submission 14xu50e [2023-07-12 12:40:38,091 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/msvns72dekbb1.jpg [2023-07-12 12:40:38,428 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/Irish94backpack_I hope you like sucking girl dick x_14xu50e.jpg [2023-07-12 12:40:38,428 - bdfr.downloader - DEBUG] - Hash added to master list: d4f4034feb7ce34d8c44814b953c2a08 [2023-07-12 12:40:38,428 - bdfr.downloader - INFO] - Downloaded submission 14xu50e from traps [2023-07-12 12:40:38,429 - bdfr.downloader - DEBUG] - Attempting to download submission 14xozxf [2023-07-12 12:40:38,429 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/o50ybi20gjbb1.jpg [2023-07-12 12:40:38,689 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/AllAccessAsianAmber_Can I be your fuck doll? 🥹_14xozxf.jpg [2023-07-12 12:40:38,689 - bdfr.downloader - DEBUG] - Hash added to master list: 02b4c5476a9d0dd2b9a60a98e6b2ec85 [2023-07-12 12:40:38,689 - bdfr.downloader - INFO] - Downloaded submission 14xozxf from traps [2023-07-12 12:40:38,689 - bdfr.downloader - DEBUG] - Attempting to download submission 14xn32z [2023-07-12 12:40:38,689 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/p1pcibge1jbb1.gif [2023-07-12 12:40:39,425 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/Lexxiraus_You got a vacant spot for my cock?_14xn32z.gif [2023-07-12 12:40:39,425 - bdfr.downloader - DEBUG] - Hash added to master list: 44ff6f9eae1a7b66890f184d875744e0 [2023-07-12 12:40:39,425 - bdfr.downloader - INFO] - Downloaded submission 14xn32z from traps [2023-07-12 12:40:39,425 - bdfr.downloader - DEBUG] - Attempting to download submission 14xnz83 [2023-07-12 12:40:39,425 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/vcezegze8jbb1.jpg [2023-07-12 12:40:39,672 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/JazzzBerrry_are you enjoying the view?_14xnz83.jpg [2023-07-12 12:40:39,672 - bdfr.downloader - DEBUG] - Hash added to master list: 13668dc8948983541df070b50f6b2847 [2023-07-12 12:40:39,672 - bdfr.downloader - INFO] - Downloaded submission 14xnz83 from traps [2023-07-12 12:40:39,672 - bdfr.downloader - DEBUG] - Attempting to download submission 14xtzz3 [2023-07-12 12:40:39,672 - bdfr.downloader - DEBUG] - Using Imgur with url https://i.imgur.com/xtIvpCg.gifv [2023-07-12 12:40:40,290 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/Amber_hawking_Do you want me to fuck you like this?_14xtzz3.mp4 [2023-07-12 12:40:40,290 - bdfr.downloader - DEBUG] - Hash added to master list: 86f3410f26fe87ccf36c3dd1d374c2e7 [2023-07-12 12:40:40,290 - bdfr.downloader - INFO] - Downloaded submission 14xtzz3 from traps [2023-07-12 12:40:40,290 - bdfr.downloader - DEBUG] - Attempting to download submission 14xrdi0 [2023-07-12 12:40:40,290 - bdfr.downloader - DEBUG] - Using Gallery with url https://www.reddit.com/gallery/14xrdi0 [2023-07-12 12:40:40,586 - bdfr.file_name_formatter - Level 9] - Formatting filename with index 1 [2023-07-12 12:40:40,587 - bdfr.file_name_formatter - Level 9] - Formatting filename with index 2 [2023-07-12 12:40:40,772 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/Ash-lee_reddit_Would you milk my little clit or pump me full of yours? 🥛😝💕_14xrdi0_1.jpg [2023-07-12 12:40:40,772 - bdfr.downloader - DEBUG] - Hash added to master list: e22beeb1ad24b7bfb5f34153dbce35d8 [2023-07-12 12:40:40,938 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/Ash-lee_reddit_Would you milk my little clit or pump me full of yours? 🥛😝💕_14xrdi0_2.jpg [2023-07-12 12:40:40,938 - bdfr.downloader - DEBUG] - Hash added to master list: 1532ee5e2441232f528065b84f69ac1d [2023-07-12 12:40:40,938 - bdfr.downloader - INFO] - Downloaded submission 14xrdi0 from traps [2023-07-12 12:40:40,938 - bdfr.downloader - DEBUG] - Attempting to download submission 14x3kfv [2023-07-12 12:40:40,938 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/z17yiyi9iebb1.png [2023-07-12 12:40:41,216 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/bootytrap69_Im that one bitch with the fat ass 😄_14x3kfv.png [2023-07-12 12:40:41,216 - bdfr.downloader - DEBUG] - Hash added to master list: 7aab99380eca2bccb1b2359de89ed65e [2023-07-12 12:40:41,216 - bdfr.downloader - INFO] - Downloaded submission 14x3kfv from traps [2023-07-12 12:40:41,216 - bdfr.downloader - DEBUG] - Attempting to download submission 14xmc9c [2023-07-12 12:40:41,216 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/m1pk5vojvibb1.jpg [2023-07-12 12:40:41,495 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/JanieBlade_Can you handle me Daddy?_14xmc9c.jpg [2023-07-12 12:40:41,496 - bdfr.downloader - DEBUG] - Hash added to master list: 68aae4b552330515879989f3b3b69e8a [2023-07-12 12:40:41,496 - bdfr.downloader - INFO] - Downloaded submission 14xmc9c from traps [2023-07-12 12:40:41,496 - bdfr.downloader - DEBUG] - Attempting to download submission 14xomco [2023-07-12 12:40:41,496 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/dtayjjx8djbb1.gif [2023-07-12 12:40:42,279 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/xMatthiax_My pp says Hi! ;)_14xomco.gif [2023-07-12 12:40:42,280 - bdfr.downloader - DEBUG] - Hash added to master list: d5cf2154d945e12692a233e87b5fd00f [2023-07-12 12:40:42,280 - bdfr.downloader - INFO] - Downloaded submission 14xomco from traps [2023-07-12 12:40:42,280 - bdfr.downloader - DEBUG] - Attempting to download submission 14xpvqg [2023-07-12 12:40:42,280 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/q8ij19b7mjbb1.jpg [2023-07-12 12:40:42,626 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/GumzyBlutz_Ride on me or suck my tits?_14xpvqg.jpg [2023-07-12 12:40:42,626 - bdfr.downloader - DEBUG] - Hash added to master list: e58bff99ff749cfb33ae85c396bd1d63 [2023-07-12 12:40:42,626 - bdfr.downloader - INFO] - Downloaded submission 14xpvqg from traps [2023-07-12 12:40:42,626 - bdfr.downloader - DEBUG] - Attempting to download submission 14xoycm [2023-07-12 12:40:42,627 - bdfr.downloader - DEBUG] - Using Redgifs with url https://www.redgifs.com/watch/chartreusetrivialaustraliancurlew [2023-07-12 12:40:43,353 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/RaiCutie_I need more in me!!!_14xoycm.mp4 [2023-07-12 12:40:43,353 - bdfr.downloader - DEBUG] - Hash added to master list: d5bd4fd90461bdb1781905148e634f9d [2023-07-12 12:40:43,353 - bdfr.downloader - INFO] - Downloaded submission 14xoycm from traps [2023-07-12 12:40:43,353 - bdfr.downloader - DEBUG] - Attempting to download submission 14xmxte [2023-07-12 12:40:43,354 - bdfr.downloader - DEBUG] - Using Redgifs with url https://www.redgifs.com/watch/forthrightforestgreengermanwirehairedpointer [2023-07-12 12:40:44,469 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/LalaThePala_Just slide inside and breed me 😍🤤_14xmxte.mp4 [2023-07-12 12:40:44,469 - bdfr.downloader - DEBUG] - Hash added to master list: 50b909387c21cee3a11de3bae38c4bc0 [2023-07-12 12:40:44,469 - bdfr.downloader - INFO] - Downloaded submission 14xmxte from traps [2023-07-12 12:40:44,470 - bdfr.downloader - DEBUG] - Attempting to download submission 14xrcbq [2023-07-12 12:40:44,470 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/4gl0nuu1wjbb1.gif [2023-07-12 12:40:46,262 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/Argyle_Fel_Selfsucking feels good, but I'd rather suck your cock_14xrcbq.gif [2023-07-12 12:40:46,262 - bdfr.downloader - DEBUG] - Hash added to master list: 778fca6a280ec7a0e66d847246ce9e41 [2023-07-12 12:40:46,262 - bdfr.downloader - INFO] - Downloaded submission 14xrcbq from traps [2023-07-12 12:40:46,263 - bdfr.downloader - DEBUG] - Attempting to download submission 14xtanq [2023-07-12 12:40:46,263 - bdfr.downloader - DEBUG] - Using Redgifs with url https://www.redgifs.com/watch/unfortunatestudiousroach [2023-07-12 12:40:47,591 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/FeedNess_Initiation_14xtanq.mp4 [2023-07-12 12:40:47,591 - bdfr.downloader - DEBUG] - Hash added to master list: fe423f3c6b9875cf8f75041a5d65a3b9 [2023-07-12 12:40:47,591 - bdfr.downloader - INFO] - Downloaded submission 14xtanq from traps [2023-07-12 12:40:47,592 - bdfr.downloader - DEBUG] - Attempting to download submission 14x9ar4 [2023-07-12 12:40:47,592 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/hn6qdnsgnfbb1.gif [2023-07-12 12:40:48,303 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/Natalia_Reyyy_Hope you don't mind if my girl cock slaps your balls as I ride you_14x9ar4.gif [2023-07-12 12:40:48,303 - bdfr.downloader - DEBUG] - Hash added to master list: d78bbd73aa7c54fc6e9b2d6d09b683fd [2023-07-12 12:40:48,303 - bdfr.downloader - INFO] - Downloaded submission 14x9ar4 from traps [2023-07-12 12:40:48,303 - bdfr.downloader - DEBUG] - Attempting to download submission 14xn8gk [2023-07-12 12:40:48,304 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/m3yd3khm2jbb1.jpg [2023-07-12 12:40:48,590 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/Angele_mhr_Who wants to join me?_14xn8gk.jpg [2023-07-12 12:40:48,591 - bdfr.downloader - DEBUG] - Hash added to master list: c3e094e8b51f78ea9f20796efebc7966 [2023-07-12 12:40:48,591 - bdfr.downloader - INFO] - Downloaded submission 14xn8gk from traps [2023-07-12 12:40:48,591 - bdfr.downloader - DEBUG] - Attempting to download submission 14xnxxz [2023-07-12 12:40:48,591 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/54agbfd68jbb1.gif [2023-07-12 12:40:49,988 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/irl_genderbender_Would your prefer taking my mouth or girl cock 😈_14xnxxz.gif [2023-07-12 12:40:49,988 - bdfr.downloader - DEBUG] - Hash added to master list: 6e71e0c3ef3ca93ac84d8f37cde28445 [2023-07-12 12:40:49,989 - bdfr.downloader - INFO] - Downloaded submission 14xnxxz from traps [2023-07-12 12:40:49,989 - bdfr.downloader - DEBUG] - Attempting to download submission 14xoode [2023-07-12 12:40:49,989 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/6no1tcgldjbb1.jpg [2023-07-12 12:40:50,193 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/brooDYABeL_Lick on that tip😈_14xoode.jpg [2023-07-12 12:40:50,194 - bdfr.downloader - DEBUG] - Hash added to master list: ddbd4b8fbf3be92eb9aec1da30c5729c [2023-07-12 12:40:50,194 - bdfr.downloader - INFO] - Downloaded submission 14xoode from traps [2023-07-12 12:40:50,194 - bdfr.downloader - DEBUG] - Attempting to download submission 14xn94k [2023-07-12 12:40:50,194 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/cmgax61t2jbb1.jpg [2023-07-12 12:40:50,627 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/tessfinessed_100% all naturál 😘🤌🏼_14xn94k.jpg [2023-07-12 12:40:50,627 - bdfr.downloader - DEBUG] - Hash added to master list: 5fb2a208fa5cc61d19533e09506302a1 [2023-07-12 12:40:50,627 - bdfr.downloader - INFO] - Downloaded submission 14xn94k from traps [2023-07-12 12:40:50,628 - bdfr.downloader - DEBUG] - Attempting to download submission 14xq939 [2023-07-12 12:40:50,628 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/st659xnsojbb1.jpg [2023-07-12 12:40:50,835 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/Femboy_Izzy_Boo!👻💖_14xq939.jpg [2023-07-12 12:40:50,835 - bdfr.downloader - DEBUG] - Hash added to master list: 13a04c9f61d666f9a613a56b267e77e1 [2023-07-12 12:40:50,835 - bdfr.downloader - INFO] - Downloaded submission 14xq939 from traps [2023-07-12 12:40:50,835 - bdfr.downloader - DEBUG] - Attempting to download submission 14xm82e [2023-07-12 12:40:50,836 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/rwcjui1nuibb1.jpg [2023-07-12 12:40:51,134 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/GalaPlacidia_Thinking what to do with you_14xm82e.jpg [2023-07-12 12:40:51,134 - bdfr.downloader - DEBUG] - Hash added to master list: 9d6306e19f5411eedd6f831f4db7a540 [2023-07-12 12:40:51,135 - bdfr.downloader - INFO] - Downloaded submission 14xm82e from traps [2023-07-12 12:40:51,135 - bdfr.downloader - DEBUG] - Attempting to download submission 14xrbxh [2023-07-12 12:40:51,135 - bdfr.downloader - DEBUG] - Using Redgifs with url https://i.redgifs.com/i/bisquefoolhardypuffer.jpg [2023-07-12 12:40:51,626 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/AvaShade_If I looked at you like this would you suck my cock?_14xrbxh.jpg [2023-07-12 12:40:51,626 - bdfr.downloader - DEBUG] - Hash added to master list: f512a1caca00555133ea851c4c3d8617 [2023-07-12 12:40:51,626 - bdfr.downloader - INFO] - Downloaded submission 14xrbxh from traps [2023-07-12 12:40:51,627 - bdfr.downloader - DEBUG] - Attempting to download submission 14xoht4 [2023-07-12 12:40:51,627 - bdfr.downloader - DEBUG] - Using Redgifs with url https://www.redgifs.com/watch/lateastonishinggrayling [2023-07-12 12:40:52,569 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/Sassyleaf_Cumming as a girl feels soo good_14xoht4.mp4 [2023-07-12 12:40:52,570 - bdfr.downloader - DEBUG] - Hash added to master list: 2867d3028bafaf1291170847091a3f4e [2023-07-12 12:40:52,570 - bdfr.downloader - INFO] - Downloaded submission 14xoht4 from traps [2023-07-12 12:40:52,570 - bdfr.downloader - DEBUG] - Attempting to download submission 14xqf5n [2023-07-12 12:40:52,570 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/14oghlbypjbb1.jpg [2023-07-12 12:40:52,730 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/AlexYourFemboy_It always pops out of my skirts_14xqf5n.jpg [2023-07-12 12:40:52,730 - bdfr.downloader - DEBUG] - Hash added to master list: 2c320798edaae3b153ef809d23573ce8 [2023-07-12 12:40:52,730 - bdfr.downloader - INFO] - Downloaded submission 14xqf5n from traps [2023-07-12 12:40:52,730 - bdfr.downloader - DEBUG] - Attempting to download submission 14xnio3 [2023-07-12 12:40:52,730 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/yjv43rrx4jbb1.jpg [2023-07-12 12:40:52,974 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/xroxywolfx_Have a nice day at work Daddy! What do you have planned for tonight? 😳_14xnio3.jpg [2023-07-12 12:40:52,974 - bdfr.downloader - DEBUG] - Hash added to master list: 7a3ffa74940ee7ff60e073994034ab92 [2023-07-12 12:40:52,974 - bdfr.downloader - INFO] - Downloaded submission 14xnio3 from traps [2023-07-12 12:40:52,975 - bdfr.downloader - DEBUG] - Attempting to download submission 14xr76o [2023-07-12 12:40:52,975 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/p3ai6ad5vjbb1.jpg [2023-07-12 12:40:53,599 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/cericyber_Reading through the messages you sent me_14xr76o.jpg [2023-07-12 12:40:53,599 - bdfr.downloader - DEBUG] - Hash added to master list: ab64f3bf64db93650e1381cb5c2faafb [2023-07-12 12:40:53,599 - bdfr.downloader - INFO] - Downloaded submission 14xr76o from traps [2023-07-12 12:40:53,600 - bdfr.downloader - DEBUG] - Attempting to download submission 14xsr7s [2023-07-12 12:40:53,600 - bdfr.downloader - DEBUG] - Using Gallery with url https://www.reddit.com/gallery/14xsr7s [2023-07-12 12:40:54,320 - bdfr.file_name_formatter - Level 9] - Formatting filename with index 1 [2023-07-12 12:40:54,320 - bdfr.file_name_formatter - Level 9] - Formatting filename with index 2 [2023-07-12 12:40:54,551 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/LunaBunnies1_Two cute pics :)_14xsr7s_1.png [2023-07-12 12:40:54,552 - bdfr.downloader - DEBUG] - Hash added to master list: 59d387df94b53913c79d12216bd377b2 [2023-07-12 12:40:54,816 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/LunaBunnies1_Two cute pics :)_14xsr7s_2.png [2023-07-12 12:40:54,816 - bdfr.downloader - DEBUG] - Hash added to master list: c9865b8ceb840bb8dd82b2bbb234d82e [2023-07-12 12:40:54,816 - bdfr.downloader - INFO] - Downloaded submission 14xsr7s from traps [2023-07-12 12:40:54,817 - bdfr.downloader - DEBUG] - Attempting to download submission 14xrget [2023-07-12 12:40:54,817 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/3292i8otwjbb1.jpg [2023-07-12 12:40:55,116 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/LunaStarflare_Wish there was something between my legs today._14xrget.jpg [2023-07-12 12:40:55,116 - bdfr.downloader - DEBUG] - Hash added to master list: 8db10530be3f076831668680f7c22680 [2023-07-12 12:40:55,116 - bdfr.downloader - INFO] - Downloaded submission 14xrget from traps [2023-07-12 12:40:55,116 - bdfr.downloader - DEBUG] - Attempting to download submission 14xs7uf [2023-07-12 12:40:55,116 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/xkqsyqqv1kbb1.jpg [2023-07-12 12:40:55,313 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/twinkinpiink_your average diamond apex player_14xs7uf.jpg [2023-07-12 12:40:55,314 - bdfr.downloader - DEBUG] - Hash added to master list: 548113326e3fd4d3325b340666518e1e [2023-07-12 12:40:55,314 - bdfr.downloader - INFO] - Downloaded submission 14xs7uf from traps [2023-07-12 12:40:55,314 - bdfr.downloader - DEBUG] - Attempting to download submission 14xkghn [2023-07-12 12:40:55,314 - bdfr.downloader - DEBUG] - Using Redgifs with url https://www.redgifs.com/watch/unfoldedbigheartedheron [2023-07-12 12:40:56,064 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/pinkprincessluna_would you fuck me?_14xkghn.mp4 [2023-07-12 12:40:56,065 - bdfr.downloader - DEBUG] - Hash added to master list: 1e0c58cc3838bfb9e10d0cdddf33af78 [2023-07-12 12:40:56,065 - bdfr.downloader - INFO] - Downloaded submission 14xkghn from traps [2023-07-12 12:40:56,065 - bdfr.downloader - DEBUG] - Attempting to download submission 14xk6c2 [2023-07-12 12:40:56,065 - bdfr.downloader - DEBUG] - Using Redgifs with url https://www.redgifs.com/watch/darkorangesnappybrontosaurus [2023-07-12 12:40:56,930 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/subhumanleech_Suck or fuck this morning? You pick :3_14xk6c2.mp4 [2023-07-12 12:40:56,931 - bdfr.downloader - DEBUG] - Hash added to master list: c05f6045751a899f47a63b034062f661 [2023-07-12 12:40:56,931 - bdfr.downloader - INFO] - Downloaded submission 14xk6c2 from traps [2023-07-12 12:40:56,931 - bdfr.downloader - DEBUG] - Attempting to download submission 14xu1um [2023-07-12 12:40:56,931 - bdfr.downloader - DEBUG] - Using Redgifs with url https://www.redgifs.com/watch/putridacidicmartin [2023-07-12 12:40:58,116 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/NuniCult_I know you'll feel amazing in my throat~_14xu1um.mp4 [2023-07-12 12:40:58,116 - bdfr.downloader - DEBUG] - Hash added to master list: b10d02f863f64fcb640b7c28653fb2b2 [2023-07-12 12:40:58,116 - bdfr.downloader - INFO] - Downloaded submission 14xu1um from traps [2023-07-12 12:40:58,117 - bdfr.downloader - DEBUG] - Attempting to download submission 14xqakl [2023-07-12 12:40:58,117 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/a4z2u8g3pjbb1.jpg [2023-07-12 12:40:58,337 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/trans_mary_Would it fit in🤔🤪💦._14xqakl.jpg [2023-07-12 12:40:58,337 - bdfr.downloader - DEBUG] - Hash added to master list: a2340cff869ab41bfa758d35e0013fda [2023-07-12 12:40:58,337 - bdfr.downloader - INFO] - Downloaded submission 14xqakl from traps [2023-07-12 12:40:58,338 - bdfr.downloader - DEBUG] - Attempting to download submission 14woj83 [2023-07-12 12:40:58,338 - bdfr.downloader - DEBUG] - Using Imgur with url https://i.imgur.com/IHuOuYk.gifv [2023-07-12 12:40:58,651 - bdfr.downloader - ERROR] - Site Imgur failed to download submission 14woj83: Server responded with 404 at https://api.imgur.com/3/image/IHuOuYk [2023-07-12 12:40:58,652 - bdfr.downloader - DEBUG] - Attempting to download submission 14xqmu6 [2023-07-12 12:40:58,652 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/50u9s5xcrjbb1.gif [2023-07-12 12:40:59,800 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/thirdworldtrans00_LOVE taking a BIG DICK as a GOOD girl hehe_14xqmu6.gif [2023-07-12 12:40:59,800 - bdfr.downloader - DEBUG] - Hash added to master list: 17327951c78051b1201c5d7489c2379b [2023-07-12 12:40:59,800 - bdfr.downloader - INFO] - Downloaded submission 14xqmu6 from traps [2023-07-12 12:40:59,801 - bdfr.downloader - DEBUG] - Attempting to download submission 14xq8xi [2023-07-12 12:40:59,801 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/2rdrrbbrojbb1.jpg [2023-07-12 12:41:00,062 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/BansheesAndBeasts_How do I look? 💕🥺_14xq8xi.jpg [2023-07-12 12:41:00,062 - bdfr.downloader - DEBUG] - Hash added to master list: 87de1997c902759c325df051b65b513f [2023-07-12 12:41:00,062 - bdfr.downloader - INFO] - Downloaded submission 14xq8xi from traps [2023-07-12 12:41:00,062 - bdfr.downloader - DEBUG] - Attempting to download submission 14xtvfs [2023-07-12 12:41:00,062 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/7lcm1vzkckbb1.jpg [2023-07-12 12:41:00,282 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/petertheeater15_Any success with this style of trap?_14xtvfs.jpg [2023-07-12 12:41:00,282 - bdfr.downloader - DEBUG] - Hash added to master list: 10f99fefbc27a3e2406566c1c4e4f871 [2023-07-12 12:41:00,282 - bdfr.downloader - INFO] - Downloaded submission 14xtvfs from traps [2023-07-12 12:41:00,282 - bdfr.downloader - DEBUG] - Attempting to download submission 14x0ixv [2023-07-12 12:41:00,282 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/esesmda3ydbb1.jpg [2023-07-12 12:41:00,573 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/Complexikitty_what would you do if you woke up next to me? 🥺_14x0ixv.jpg [2023-07-12 12:41:00,573 - bdfr.downloader - DEBUG] - Hash added to master list: 42c3629bec53a9c76537c7247b45f831 [2023-07-12 12:41:00,573 - bdfr.downloader - INFO] - Downloaded submission 14x0ixv from traps [2023-07-12 12:41:00,573 - bdfr.downloader - DEBUG] - Attempting to download submission 14xrjvy [2023-07-12 12:41:00,573 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/nugjgh3ixjbb1.jpg [2023-07-12 12:41:00,772 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/IndieeeChic_Spread your legs baby, mommy’s gonna fuck you😈_14xrjvy.jpg [2023-07-12 12:41:00,772 - bdfr.downloader - DEBUG] - Hash added to master list: a5e6cd9a7e6030cb860636d9393345e3 [2023-07-12 12:41:00,772 - bdfr.downloader - INFO] - Downloaded submission 14xrjvy from traps [2023-07-12 12:41:00,772 - bdfr.downloader - DEBUG] - Attempting to download submission 14xogty [2023-07-12 12:41:00,772 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/to1kcgl0cjbb1.jpg [2023-07-12 12:41:01,035 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/misstyn_Would we take turns fucking each other if you find me in your room like that?_14xogty.jpg [2023-07-12 12:41:01,035 - bdfr.downloader - DEBUG] - Hash added to master list: 80c2c7703f5c9ec1f342384c612d79d0 [2023-07-12 12:41:01,035 - bdfr.downloader - INFO] - Downloaded submission 14xogty from traps [2023-07-12 12:41:01,035 - bdfr.downloader - DEBUG] - Attempting to download submission 14xsi5i [2023-07-12 12:41:01,035 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/bu10q6wwyjbb1.gif [2023-07-12 12:41:02,803 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/frycl2014_Question… are you the cock or the ass here?_14xsi5i.gif [2023-07-12 12:41:02,803 - bdfr.downloader - DEBUG] - Hash added to master list: 79d769ae700acd4b94f8d878e00cbaa2 [2023-07-12 12:41:02,803 - bdfr.downloader - INFO] - Downloaded submission 14xsi5i from traps [2023-07-12 12:41:02,803 - bdfr.downloader - DEBUG] - Attempting to download submission 14xraas [2023-07-12 12:41:02,803 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/wzzd30apvjbb1.jpg [2023-07-12 12:41:03,090 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/Edgedancer_822_This is what hides under my skirt_14xraas.jpg [2023-07-12 12:41:03,091 - bdfr.downloader - DEBUG] - Hash added to master list: d9d4780104ec800c00a810187ea55280 [2023-07-12 12:41:03,091 - bdfr.downloader - INFO] - Downloaded submission 14xraas from traps [2023-07-12 12:41:03,091 - bdfr.downloader - DEBUG] - Attempting to download submission 14xule7 [2023-07-12 12:41:03,091 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/qfwpjynsgkbb1.jpg [2023-07-12 12:41:03,423 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/MamaMephistopheles_POV: the succubus is about to fuck out your soul 😈_14xule7.jpg [2023-07-12 12:41:03,423 - bdfr.downloader - DEBUG] - Hash added to master list: fed3b611b7d40f807bc04f5b5a78b128 [2023-07-12 12:41:03,423 - bdfr.downloader - INFO] - Downloaded submission 14xule7 from traps [2023-07-12 12:41:03,423 - bdfr.downloader - DEBUG] - Attempting to download submission 14xsycz [2023-07-12 12:41:03,424 - bdfr.downloader - DEBUG] - Using Redgifs with url https://www.redgifs.com/watch/warlikeenormoushairstreak [2023-07-12 12:41:04,259 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/Kirliaaa_Would you fuck me if we woke up together? 😳💕_14xsycz.mp4 [2023-07-12 12:41:04,259 - bdfr.downloader - DEBUG] - Hash added to master list: 94dd17057e1d72af0585b5a051dd9ea7 [2023-07-12 12:41:04,259 - bdfr.downloader - INFO] - Downloaded submission 14xsycz from traps [2023-07-12 12:41:04,259 - bdfr.downloader - DEBUG] - Attempting to download submission 14xsu7z [2023-07-12 12:41:04,260 - bdfr.downloader - DEBUG] - Using Redgifs with url https://www.redgifs.com/watch/deadlyvapidiberianmidwifetoad [2023-07-12 12:41:05,193 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/KinseySaintClair_Would you be the chair? 🥺👉🏼👈🏼_14xsu7z.mp4 [2023-07-12 12:41:05,193 - bdfr.downloader - DEBUG] - Hash added to master list: eb2c4dc9009e3e048623670f9d8ec7dd [2023-07-12 12:41:05,193 - bdfr.downloader - INFO] - Downloaded submission 14xsu7z from traps [2023-07-12 12:41:05,193 - bdfr.downloader - DEBUG] - Attempting to download submission 14xpmj8 [2023-07-12 12:41:05,193 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/z8u4ikndkjbb1.gif [2023-07-12 12:41:05,844 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/MunizBabi69_If I let you suck my Girlcock would you bump up my grade, professor?_14xpmj8.gif [2023-07-12 12:41:05,844 - bdfr.downloader - DEBUG] - Hash added to master list: 179abd537ffde6110249a4a44daaf6f6 [2023-07-12 12:41:05,844 - bdfr.downloader - INFO] - Downloaded submission 14xpmj8 from traps [2023-07-12 12:41:05,844 - bdfr.downloader - DEBUG] - Attempting to download submission 14wsh5j [2023-07-12 12:41:05,844 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/crlxlujofcbb1.jpg [2023-07-12 12:41:06,088 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/xroxywolfx_Do you think it would fit 😳?_14wsh5j.jpg [2023-07-12 12:41:06,088 - bdfr.downloader - DEBUG] - Hash added to master list: c5da9acb8f2b5c86f2856d22beebf6e0 [2023-07-12 12:41:06,088 - bdfr.downloader - INFO] - Downloaded submission 14wsh5j from traps [2023-07-12 12:41:06,088 - bdfr.downloader - DEBUG] - Attempting to download submission 14xsmyx [2023-07-12 12:41:06,088 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/5zsmzhkk4kbb1.jpg [2023-07-12 12:41:06,352 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/pebblysx_Sucking or fucking, which first?_14xsmyx.jpg [2023-07-12 12:41:06,352 - bdfr.downloader - DEBUG] - Hash added to master list: add1f3c4630e9d45e9dd3d189175b619 [2023-07-12 12:41:06,352 - bdfr.downloader - INFO] - Downloaded submission 14xsmyx from traps [2023-07-12 12:41:06,352 - bdfr.downloader - DEBUG] - Attempting to download submission 14xli1z [2023-07-12 12:41:06,352 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/07muax4loibb1.gif [2023-07-12 12:41:07,897 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/alliecheeks_Do you like rock hard cocks?_14xli1z.gif [2023-07-12 12:41:07,897 - bdfr.downloader - DEBUG] - Hash added to master list: 0557c16c9a5fdeffc7a25e42204ab6ad [2023-07-12 12:41:07,897 - bdfr.downloader - INFO] - Downloaded submission 14xli1z from traps [2023-07-12 12:41:07,897 - bdfr.downloader - DEBUG] - Attempting to download submission 14x7a1w [2023-07-12 12:41:07,897 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/h9pxltjw7fbb1.gif [2023-07-12 12:41:08,733 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/tsfoxyanastasia_I have a surprise for you after we get home from our date.._14x7a1w.gif [2023-07-12 12:41:08,733 - bdfr.downloader - DEBUG] - Hash added to master list: 182e2b97339292c2b95757f713fd115a [2023-07-12 12:41:08,733 - bdfr.downloader - INFO] - Downloaded submission 14x7a1w from traps [2023-07-12 12:41:08,734 - bdfr.downloader - DEBUG] - Attempting to download submission 14xs679 [2023-07-12 12:41:08,734 - bdfr.downloader - DEBUG] - Using Redgifs with url https://www.redgifs.com/watch/acrobaticleftarmednylonshrimp [2023-07-12 12:41:09,469 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/majinkunbuu_Happy Humpday_14xs679.mp4 [2023-07-12 12:41:09,470 - bdfr.downloader - DEBUG] - Hash added to master list: 1a405ab5a273b80598f6080aa01bd1e3 [2023-07-12 12:41:09,470 - bdfr.downloader - INFO] - Downloaded submission 14xs679 from traps [2023-07-12 12:41:09,470 - bdfr.downloader - DEBUG] - Attempting to download submission 14xpv3c [2023-07-12 12:41:09,470 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/5nbqep43mjbb1.jpg [2023-07-12 12:41:09,710 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/JacquelineJasper_Harley has a surprise for her puddin~_14xpv3c.jpg [2023-07-12 12:41:09,710 - bdfr.downloader - DEBUG] - Hash added to master list: 050ab93369029bcf0bc4d0537332b3e0 [2023-07-12 12:41:09,710 - bdfr.downloader - INFO] - Downloaded submission 14xpv3c from traps [2023-07-12 12:41:09,710 - bdfr.downloader - DEBUG] - Attempting to download submission 14xmy6q [2023-07-12 12:41:09,710 - bdfr.downloader - DEBUG] - Using Redgifs with url https://www.redgifs.com/watch/boldwindingquillback [2023-07-12 12:41:10,399 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/Knowncow0907_Im always dripping cum hehe_14xmy6q.mp4 [2023-07-12 12:41:10,399 - bdfr.downloader - DEBUG] - Hash added to master list: f5066ce9db4e4c8da70af84b1f336f36 [2023-07-12 12:41:10,399 - bdfr.downloader - INFO] - Downloaded submission 14xmy6q from traps [2023-07-12 12:41:10,399 - bdfr.downloader - DEBUG] - Attempting to download submission 14xqrb0 [2023-07-12 12:41:10,399 - bdfr.downloader - DEBUG] - Using Redgifs with url https://www.redgifs.com/watch/brownmoralgypsymoth [2023-07-12 12:41:11,262 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/KikiMiky__I can keep on for hours, trust me_14xqrb0.mp4 [2023-07-12 12:41:11,262 - bdfr.downloader - DEBUG] - Hash added to master list: 65da897d82ea176c61287087045d8d9e [2023-07-12 12:41:11,262 - bdfr.downloader - INFO] - Downloaded submission 14xqrb0 from traps [2023-07-12 12:41:11,263 - bdfr.downloader - DEBUG] - Attempting to download submission 14xt18z [2023-07-12 12:41:11,263 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/co9upul37kbb1.jpg [2023-07-12 12:41:11,568 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/sissy_emilyxoxo_Pink to make all of the boys wink! And maybe suck their cocks too!_14xt18z.jpg [2023-07-12 12:41:11,568 - bdfr.downloader - DEBUG] - Hash added to master list: 58af65a642b7bded1f0cc01054577b96 [2023-07-12 12:41:11,568 - bdfr.downloader - INFO] - Downloaded submission 14xt18z from traps [2023-07-12 12:41:11,568 - bdfr.downloader - DEBUG] - Attempting to download submission 14xeu2t [2023-07-12 12:41:11,568 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/pcqk2q6lxgbb1.jpg [2023-07-12 12:41:11,861 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/Ariathetransfairy_If we fucked would you rather be the Top? The Bottom? Or Both?😈💕_14xeu2t.jpg [2023-07-12 12:41:11,861 - bdfr.downloader - DEBUG] - Hash added to master list: 4dce15f6fe46b77616771b84c696c3c0 [2023-07-12 12:41:11,861 - bdfr.downloader - INFO] - Downloaded submission 14xeu2t from traps [2023-07-12 12:41:11,861 - bdfr.downloader - DEBUG] - Attempting to download submission 14xo8is [2023-07-12 12:41:11,861 - bdfr.downloader - DEBUG] - Using Redgifs with url https://www.redgifs.com/watch/lostlostkagu [2023-07-12 12:41:12,693 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/analcurve_My ass is hungry_14xo8is.mp4 [2023-07-12 12:41:12,693 - bdfr.downloader - DEBUG] - Hash added to master list: bad52a1cca817390616ffc15bc770f8d [2023-07-12 12:41:12,693 - bdfr.downloader - INFO] - Downloaded submission 14xo8is from traps [2023-07-12 12:41:12,694 - bdfr.downloader - DEBUG] - Attempting to download submission 14xqeya [2023-07-12 12:41:12,694 - bdfr.downloader - DEBUG] - Using Redgifs with url https://www.redgifs.com/watch/vapidacrobaticsteer [2023-07-12 12:41:13,662 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/ConfectionLopsided97_Come play with me and my bear 🖤🖤_14xqeya.mp4 [2023-07-12 12:41:13,662 - bdfr.downloader - DEBUG] - Hash added to master list: c09c8f4deef2e265f1a96d1bf26cda3a [2023-07-12 12:41:13,662 - bdfr.downloader - INFO] - Downloaded submission 14xqeya from traps [2023-07-12 12:41:13,662 - bdfr.downloader - DEBUG] - Attempting to download submission 14xeq6p [2023-07-12 12:41:13,662 - bdfr.downloader - DEBUG] - Using Redgifs with url https://www.redgifs.com/watch/spottedmulticoloredumbrette [2023-07-12 12:41:14,516 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/PuppyGirlX3_Would you rather cum on my toes or in my throat?_14xeq6p.mp4 [2023-07-12 12:41:14,516 - bdfr.downloader - DEBUG] - Hash added to master list: 5d373aa0a24d5246be042903261829a5 [2023-07-12 12:41:14,516 - bdfr.downloader - INFO] - Downloaded submission 14xeq6p from traps [2023-07-12 12:41:14,517 - bdfr.downloader - DEBUG] - Attempting to download submission 14wsvf5 [2023-07-12 12:41:14,517 - bdfr.downloader - DEBUG] - Using Imgur with url https://i.imgur.com/PYRu2l5.gifv [2023-07-12 12:41:14,722 - bdfr.downloader - ERROR] - Site Imgur failed to download submission 14wsvf5: Server responded with 404 at https://api.imgur.com/3/image/PYRu2l5 [2023-07-12 12:41:14,723 - bdfr.downloader - DEBUG] - Attempting to download submission 14wrkjm [2023-07-12 12:41:14,723 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/va2fchia9cbb1.jpg [2023-07-12 12:41:14,889 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/TechnoAlways_Nurse ya into a trap?_14wrkjm.jpg [2023-07-12 12:41:14,889 - bdfr.downloader - DEBUG] - Hash added to master list: 72a028bd935920455d5858ba2da486f8 [2023-07-12 12:41:14,889 - bdfr.downloader - INFO] - Downloaded submission 14wrkjm from traps [2023-07-12 12:41:14,889 - bdfr.downloader - DEBUG] - Attempting to download submission 14xfuki [2023-07-12 12:41:14,889 - bdfr.downloader - DEBUG] - Using Redgifs with url https://www.redgifs.com/watch/farflunglightlemur [2023-07-12 12:41:15,835 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/Adamfurrow_Would you let me throat you while you drive?_14xfuki.mp4 [2023-07-12 12:41:15,836 - bdfr.downloader - DEBUG] - Hash added to master list: 326d2eace74d99e32802c9d0d8713520 [2023-07-12 12:41:15,836 - bdfr.downloader - INFO] - Downloaded submission 14xfuki from traps [2023-07-12 12:41:15,836 - bdfr.downloader - DEBUG] - Attempting to download submission 14xf725 [2023-07-12 12:41:15,836 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/ddxv0ge21hbb1.gif [2023-07-12 12:41:17,290 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/AngelAvaa_prettiest girl dick💕_14xf725.gif [2023-07-12 12:41:17,290 - bdfr.downloader - DEBUG] - Hash added to master list: 003d1f40d63023a4cb273878b4e788d8 [2023-07-12 12:41:17,290 - bdfr.downloader - INFO] - Downloaded submission 14xf725 from traps [2023-07-12 12:41:17,399 - bdfr.downloader - ERROR] - The submission after 14xf725 failed to download due to a PRAW exception: received 429 HTTP response [2023-07-12 12:41:17,399 - bdfr.downloader - DEBUG] - Waiting 60 seconds to continue [2023-07-12 12:42:17,400 - root - INFO] - Program complete - BDFR Downloader v2.7.0

gemini0x2 commented 1 year ago

I'm dealing with this new error too.

Root-FTW commented 1 year ago

same error here:

D:\Videos>bdfr download D:\Videos --opts fortnite.yaml Traceback (most recent call last): File "C:\Users\rootf\AppData\Local\Programs\Python\Python39\lib\runpy.py", line 197, in _run_module_as_main return _run_code(code, main_globals, None, File "C:\Users\rootf\AppData\Local\Programs\Python\Python39\lib\runpy.py", line 87, in _run_code exec(code, run_globals) File "C:\Users\rootf\AppData\Local\Programs\Python\Python39\Scripts\bdfr.exe__main.py", line 7, in File "C:\Users\rootf\AppData\Local\Programs\Python\Python39\lib\site-packages\click\core.py", line 1130, in call return self.main(*args, kwargs) File "C:\Users\rootf\AppData\Local\Programs\Python\Python39\lib\site-packages\click\core.py", line 1055, in main rv = self.invoke(ctx) File "C:\Users\rootf\AppData\Local\Programs\Python\Python39\lib\site-packages\click\core.py", line 1657, in invoke return _process_result(sub_ctx.command.invoke(sub_ctx)) File "C:\Users\rootf\AppData\Local\Programs\Python\Python39\lib\site-packages\click\core.py", line 1404, in invoke return ctx.invoke(self.callback, ctx.params) File "C:\Users\rootf\AppData\Local\Programs\Python\Python39\lib\site-packages\click\core.py", line 760, in invoke return callback(*args, *kwargs) File "C:\Users\rootf\AppData\Local\Programs\Python\Python39\lib\site-packages\click\decorators.py", line 26, in new_func return f(get_current_context(), args, kwargs) File "C:\Users\rootf\AppData\Local\Programs\Python\Python39\lib\site-packages\bdfr__main.py", line 117, in cli_download reddit_downloader = RedditDownloader(config, [stream]) File "C:\Users\rootf\AppData\Local\Programs\Python\Python39\lib\site-packages\bdfr\downloader.py", line 41, in init super(RedditDownloader, self).init__(args, logging_handlers) File "C:\Users\rootf\AppData\Local\Programs\Python\Python39\lib\site-packages\bdfr\connector.py", line 65, in init self.reddit_lists = self.retrieve_reddit_lists() File "C:\Users\rootf\AppData\Local\Programs\Python\Python39\lib\site-packages\bdfr\connector.py", line 168, in retrieve_reddit_lists master_list.extend(self.get_subreddits()) File "C:\Users\rootf\AppData\Local\Programs\Python\Python39\lib\site-packages\bdfr\connector.py", line 276, in get_subreddits self.check_subreddit_status(reddit) File "C:\Users\rootf\AppData\Local\Programs\Python\Python39\lib\site-packages\bdfr\connector.py", line 438, in check_subreddit_status assert subreddit.id File "C:\Users\rootf\AppData\Local\Programs\Python\Python39\lib\site-packages\praw\models\reddit\base.py", line 35, in getattr self._fetch() File "C:\Users\rootf\AppData\Local\Programs\Python\Python39\lib\site-packages\praw\models\reddit\subreddit.py", line 827, in _fetch data = self._fetch_data() File "C:\Users\rootf\AppData\Local\Programs\Python\Python39\lib\site-packages\praw\models\reddit\base.py", line 89, in _fetch_data return self._reddit.request(method="GET", params=params, path=path) File "C:\Users\rootf\AppData\Local\Programs\Python\Python39\lib\site-packages\praw\util\deprecate_args.py", line 43, in wrapped return func(dict(zip(_old_args, args)), **kwargs) File "C:\Users\rootf\AppData\Local\Programs\Python\Python39\lib\site-packages\praw\reddit.py", line 941, in request return self._core.request( File "C:\Users\rootf\AppData\Local\Programs\Python\Python39\lib\site-packages\prawcore\sessions.py", line 330, in request return self._request_with_retries( File "C:\Users\rootf\AppData\Local\Programs\Python\Python39\lib\site-packages\prawcore\sessions.py", line 266, in _request_with_retries raise self.STATUS_EXCEPTIONSresponse.status_code prawcore.exceptions.TooManyRequests: received 429 HTTP response

jaxjexjox commented 1 year ago

I run BDFR within a docker container. I believe it's located here. https://github.com/overbyrn/docker-bdfr

I have 'fixed' some issues with the docker version, very poorly (as a newbie) by injecting some commands in.

Those commands being:

sudo docker exec bdfr apt-get update -y sudo docker exec bdfr apt-get upgrade -y sudo docker exec bdfr apt-get dist-upgrade -y sudo docker exec bdfr apt install ffmpeg -y

and most importantly, this one: sudo docker exec bdfr pip install --upgrade praw

Sadly, I am still getting errors.

Traceback (most recent call last): File "/usr/local/lib/python3.9/runpy.py", line 197, in _run_module_as_main return _run_code(code, main_globals, None, File "/usr/local/lib/python3.9/runpy.py", line 87, in _run_code exec(code, run_globals) File "/usr/local/lib/python3.9/site-packages/bdfr/__main__.py", line 160, in <module> cli() File "/usr/local/lib/python3.9/site-packages/click/core.py", line 1130, in __call__ return self.main(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/click/core.py", line 1055, in main rv = self.invoke(ctx) File "/usr/local/lib/python3.9/site-packages/click/core.py", line 1657, in invoke return _process_result(sub_ctx.command.invoke(sub_ctx)) File "/usr/local/lib/python3.9/site-packages/click/core.py", line 1404, in invoke return ctx.invoke(self.callback, **ctx.params)

To be clear, I get those errors WITH or WITHOUT upgrading praw.

I suspect something has broken. If I can help more, please let me know. I suspect things may be slightly off, due to me running it from within someone elses custom docker build?

Serene-Arc commented 1 year ago

This is because of the new Reddit policy, 429 means 'Too Many Requests', it's the rate limiting error.

jaxjexjox commented 1 year ago

Well that sounds like we'd need some way to reduce the requests. I'm ok with that too, I can just leave it run overnight.

drebob24 commented 1 year ago

The same essentially happens if you try process a bunch of links with JDownloader. Limiting each batch to <100 and spacing them out fixes the problem. Similarly, a bulk download of a subreddit with lots of videos never hit the 429 error compared to one filled with smaller files I assume because the time spent downloading the videos spaced things out enough to not hit the request limit. It looks like with the new API changes bdfr needs to slow down how much it downloads/minute either with a delay between each request or pausing after 90 or so requests with a wait timer before doing the next 90 requests.

Kudos6505 commented 1 year ago

I am also having this issue, but limiting doesn't help. Even authenticated, I get extremely rate limited, with downloading only a couple text posts (no comments) giving the error.

C:\Users\piguy.DESKTOP-73IAHP5>py -m bdfr download D:\HFY-Stories\NoP\A_Recipe_ForDisaster --user YakiTapioca --submitted --authenticate --file-scheme {TITLE}{REDDITOR}{POSTID}{DATE} -L 10 -v [2023-07-14 22:27:38,144 - bdfr.connector - DEBUG] - Loading configuration from C:\Users\piguy.DESKTOP-73IAHP5\AppData\Local\BDFR\bdfr\default_config.cfg [2023-07-14 22:27:38,147 - bdfr.connector - DEBUG] - Setting maximum download wait time to 120 seconds [2023-07-14 22:27:38,147 - bdfr.connector - DEBUG] - Setting datetime format string to ISO [2023-07-14 22:27:38,148 - bdfr.connector - DEBUG] - Disabling the following modules: [2023-07-14 22:27:38,151 - bdfr.connector - DEBUG] - Using authenticated Reddit instance Traceback (most recent call last): File "C:\Users\piguy.DESKTOP-73IAHP5\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 196, in _run_module_as_main return _run_code(code, main_globals, None, File "C:\Users\piguy.DESKTOP-73IAHP5\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 86, in _run_code exec(code, run_globals) File "C:\Users\piguy.DESKTOP-73IAHP5\AppData\Local\Programs\Python\Python310\lib\site-packages\bdfr__main.py", line 162, in cli() File "C:\Users\piguy.DESKTOP-73IAHP5\AppData\Local\Programs\Python\Python310\lib\site-packages\click\core.py", line 1130, in call return self.main(*args, kwargs) File "C:\Users\piguy.DESKTOP-73IAHP5\AppData\Local\Programs\Python\Python310\lib\site-packages\click\core.py", line 1055, in main rv = self.invoke(ctx) File "C:\Users\piguy.DESKTOP-73IAHP5\AppData\Local\Programs\Python\Python310\lib\site-packages\click\core.py", line 1657, in invoke return _process_result(sub_ctx.command.invoke(sub_ctx)) File "C:\Users\piguy.DESKTOP-73IAHP5\AppData\Local\Programs\Python\Python310\lib\site-packages\click\core.py", line 1404, in invoke return ctx.invoke(self.callback, ctx.params) File "C:\Users\piguy.DESKTOP-73IAHP5\AppData\Local\Programs\Python\Python310\lib\site-packages\click\core.py", line 760, in invoke return callback(*args, *kwargs) File "C:\Users\piguy.DESKTOP-73IAHP5\AppData\Local\Programs\Python\Python310\lib\site-packages\click\decorators.py", line 26, in new_func return f(get_current_context(), args, kwargs) File "C:\Users\piguy.DESKTOP-73IAHP5\AppData\Local\Programs\Python\Python310\lib\site-packages\bdfr__main.py", line 90, in cli_download reddit_downloader = RedditDownloader(config) File "C:\Users\piguy.DESKTOP-73IAHP5\AppData\Local\Programs\Python\Python310\lib\site-packages\bdfr\downloader.py", line 39, in init super(RedditDownloader, self).init(args) File "C:\Users\piguy.DESKTOP-73IAHP5\AppData\Local\Programs\Python\Python310\lib\site-packages\bdfr\connector.py", line 59, in init self.reddit_lists = self.retrieve_reddit_lists() File "C:\Users\piguy.DESKTOP-73IAHP5\AppData\Local\Programs\Python\Python310\lib\site-packages\bdfr\connector.py", line 160, in retrieve_reddit_lists master_list.extend(self.get_user_data()) File "C:\Users\piguy.DESKTOP-73IAHP5\AppData\Local\Programs\Python\Python310\lib\site-packages\bdfr\connector.py", line 356, in get_user_data self.check_user_existence(user) File "C:\Users\piguy.DESKTOP-73IAHP5\AppData\Local\Programs\Python\Python310\lib\site-packages\bdfr\connector.py", line 383, in check_user_existence if user.id: File "C:\Users\piguy.DESKTOP-73IAHP5\AppData\Local\Programs\Python\Python310\lib\site-packages\praw\models\reddit\base.py", line 35, in getattr__ self._fetch() File "C:\Users\piguy.DESKTOP-73IAHP5\AppData\Local\Programs\Python\Python310\lib\site-packages\praw\models\reddit\redditor.py", line 179, in _fetch data = self._fetch_data() File "C:\Users\piguy.DESKTOP-73IAHP5\AppData\Local\Programs\Python\Python310\lib\site-packages\praw\models\reddit\base.py", line 89, in _fetch_data return self._reddit.request(method="GET", params=params, path=path) File "C:\Users\piguy.DESKTOP-73IAHP5\AppData\Local\Programs\Python\Python310\lib\site-packages\praw\util\deprecate_args.py", line 43, in wrapped return func(dict(zip(_old_args, args)), **kwargs) File "C:\Users\piguy.DESKTOP-73IAHP5\AppData\Local\Programs\Python\Python310\lib\site-packages\praw\reddit.py", line 941, in request return self._core.request( File "C:\Users\piguy.DESKTOP-73IAHP5\AppData\Local\Programs\Python\Python310\lib\site-packages\prawcore\sessions.py", line 330, in request return self._request_with_retries( File "C:\Users\piguy.DESKTOP-73IAHP5\AppData\Local\Programs\Python\Python310\lib\site-packages\prawcore\sessions.py", line 266, in _request_with_retries raise self.STATUS_EXCEPTIONSresponse.status_code prawcore.exceptions.TooManyRequests: received 429 HTTP response

I did do a massive archive in the past, but it has been several days with no downloads since. I have tried waiting hours between downloads of 10 posts, but it always fails at least once, usually at the first post. I can load posts on my account and computer fine, but this application has lots of trouble.

Would changing User agent or API access work? Providing an option to add time between post downloads could also help, but I don't know how extreme it would have to be.

Serene-Arc commented 1 year ago

Yes, I'm going to work on this on my tomorrow. Basically Reddit has instituted rate limits that are per app. That means that while you're using the provided client ID and secret, every single user of the BDFR has a combined quota. All of you using it are making it extremely hard for anyone to use it at all.

I'll be working on a message that displays when this happens but you can change the client ID on your own. The configuration file has that. If you register your own application with Reddit, the BDFR will work much better, though there will still be quotas on your number of requests. I'll be adding logic to wait for the reset and handle these errors better and tightening up the number of requests where I can but, for now, registering your own application would be best.

Kudos6505 commented 1 year ago

This is the same problem Apollo and other 3rd party apps are having, right? Do we use "https://old.reddit.com/prefs/apps/" or "https://support.reddithelp.com/hc/en-us/requests/new?ticket_form_id=14868593862164" to register an app?

Also, thank you for working on this. With how bad reddit is shutting down access, I am glad people are still helping others get data out.

markl181 commented 1 year ago

You'll need to go to https://old.reddit.com/prefs/apps/ - I used a localhost URL for the about and redirect, and selected web app. Then go to the default_config.cfg file, which for me is in c:\users[username]\appdata\local\bdfr\bdfr, and replace the id, which is at the top of the app page in reddit under the name, and the secret, which is visible when you create the app.

Written2001 commented 1 year ago

@markl181 which exact URL did you use for the redirect and about? I've tried http://localhost, registered a web app, changed the id and the secret in the defaults_config.cfg but without success. The logs still state [2023-07-15 13:06:15,092 - bdfr.connector - DEBUG] - Using unauthenticated Reddit instance. Followed by the error above.

Serene-Arc commented 1 year ago

The BDFR can do the registration itself. You just need to get the client ID and secret here and then put that into the configuration file.

For the website, set http://localhost:7634/ as the URL, that's what the BDFR will return to. The implementation is in bdfr/oauth2.py.

Written2001 commented 1 year ago

Thanks a lot it works now! I just mixed up the --config and --opts path and wasn't setting the correct config file.

samawss commented 1 year ago

Thanks a lot it works now! I just mixed up the --config and --opts path and wasn't setting the correct config file.

Can you tell the exact command you used thats working now? I am getting same error

jaxjexjox commented 1 year ago

Yes, I'm going to work on this on my tomorrow. Basically Reddit has instituted rate limits that are per app. That means that while you're using the provided client ID and secret, every single user of the BDFR has a combined quota. All of you using it are making it extremely hard for anyone to use it at all.

I'll be working on a message that displays when this happens but you can change the client ID on your own. The configuration file has that. If you register your own application with Reddit, the BDFR will work much better, though there will still be quotas on your number of requests. I'll be adding logic to wait for the reset and handle these errors better and tightening up the number of requests where I can but, for now, registering your own application would be best.

This effort is very much appreciated, honestly I expected with all this work you might just drop it. It's much appreciated.

Serene-Arc commented 1 year ago

Hopefully it won't be too much work, but due to the way the repository is set up, it'll limit when I can make a new master release. I don't have the power to change the secrets we use for tests, nor do I have the power to override a merge block into master because of said tests. I'll fix the problem and then see if I can get Ali to change it over.

I did bring up moving the repository to an organisational account, but that's its own set of problems, not least that it would effectively create a new repository that this one would have to link to, so it's not an immediate fix anyway.

Serene-Arc commented 1 year ago

So...fixing this will take a fair bit of work. The way PRAW works is that it uses lazy variables. That means any time that the code calls a variable, it could potentially call Reddit. Any call could then return a 429 error and, of course, PRAW doesn't offer any way to deal with this.

I'll have to go through all of the core code and refactor it into more atomic parts. Then I'll have to wrap all of them in code to make it wait and not lose too much work so...hopefully it won't take too long.

nascentt commented 1 year ago

many thanks everyone. I condensed the steps for anyone like me having issues:

go to https://old.reddit.com/prefs/apps/
I already had Bulk Downloader For Reddit - but I understand that one uses a shared client id so I created a new key at the bottom of the page.
name: bdfr
web app
description: bdfr
about url: http://localhost:7634
redirect url: http://localhost:7634
run notepad %LOCALAPPDATA%\bdfr\bdfr\default_config.cfg
copy the secret from the webpage to the cfg file to client_secret
and the client id which is displayed under web app on the web page and next to the icon to client_id in the cfg file
then ensure you use --authenticate with your bdfr download commands

GarethFreeman commented 1 year ago

many thanks everyone. I condensed the steps for anyone like me having issues:

* go to https://old.reddit.com/prefs/apps/

* I already had Bulk Downloader For Reddit - but I understand that one uses a shared client id so I created a new key at the bottom of the page.

* name: bdfr

* web app

* description: bdfr

* about url: http://localhost:7634/

* redirect url: http://localhost:7634/

* run
  notepad %LOCALAPPDATA%\bdfr\bdfr\default_config.cfg

* copy the secret from the webpage to the cfg file to client_secret

* and the client id which is displayed under web app on the web page and next to the icon to client_id in the cfg file

* then ensure you use --authenticate with your bdfr download commands

This still isn't working for me. I get this response in cmd: py -3 -m bdfr download C:\bdfrips\dft --user diffecit --submitted --authenticate [2023-07-16 19:03:40,782 - bdfr.oauth2 - WARNING] - Authentication action required before the program can proceed [2023-07-16 19:03:40,782 - bdfr.oauth2 - WARNING] - Authenticate at https://www.reddit.com/api/v1/authorize?client_id=9aSFgyzrSacy4WqMzFqjCw&duration=permanent&redirect_uri=http%3A%2F%2Flocalhost%3A7634&response_type=code&scope=identity+save+read+history&state=6888

The link on reddit then says:

bad request (reddit.com)

you sent an invalid request — invalid redirect_uri parameter.

I have done everything in your post correctly. What's the problem?

gemini0x2 commented 1 year ago

For those having problems with using their own client_id and client_secret. This is what I did.

How to use bdfr with your own `client_id` and `client_secret` (Easy):

Go to https://old.reddit.com/prefs/apps and click on create an app...
Fill out the form then click on create app
Take note of your client_id and client_secret
Create a txt file and copy the following into the file.

[DEFAULT]
client_id = 12345
client_secret = 12345
scopes = identity, history, read, save, mysubreddits
backup_log_count = 3
max_wait_time = 120
time_format = ISO

Replace the client_id and client_secret values with your own values. Save and rename the file to my_config.cfg
When running bdfr make sure you run it with the --config flag to use your my_config.cfg . For example. bdfr download ./path/to/output --user user --submitted --config ./path/to/my_config.cfg

Loriden commented 1 year ago

many thanks everyone. I condensed the steps for anyone like me having issues:
* go to https://old.reddit.com/prefs/apps/

* I already had Bulk Downloader For Reddit - but I understand that one uses a shared client id so I created a new key at the bottom of the page.

* name: bdfr

* web app

* description: bdfr

* about url: http://localhost:7634/

* redirect url: http://localhost:7634/

* run
  notepad %LOCALAPPDATA%\bdfr\bdfr\default_config.cfg

* copy the secret from the webpage to the cfg file to client_secret

* and the client id which is displayed under web app on the web page and next to the icon to client_id in the cfg file

* then ensure you use --authenticate with your bdfr download commands
This still isn't working for me. I get this response in cmd: py -3 -m bdfr download C:\bdfrips\dft --user diffecit --submitted --authenticate [2023-07-16 19:03:40,782 - bdfr.oauth2 - WARNING] - Authentication action required before the program can proceed [2023-07-16 19:03:40,782 - bdfr.oauth2 - WARNING] - Authenticate at https://www.reddit.com/api/v1/authorize?client_id=9aSFgyzrSacy4WqMzFqjCw&duration=permanent&redirect_uri=http%3A%2F%2Flocalhost%3A7634&response_type=code&scope=identity+save+read+history&state=6888

The link on reddit then says:

bad request (reddit.com)

you sent an invalid request — invalid redirect_uri parameter.

I have done everything in your post correctly. What's the problem?

Remove the trailing '/' in the redirect URI section of the reddiu web app - see the screenshots above from @Gavriik and note that they is no slash at the end of the redirect and about URIs

M-Paulsen commented 1 year ago

I get the error below during the authentication part.

The auth part seems to work just fine on the reddit side, it's just gives this error 500 on the return.

I am running bdfr on a separate server and doing the auth on my desktop. I've done the same previously with other programs that use reddit api without issue though.

[2023-07-17 16:26:00,363 - bdfr.oauth2 - WARNING] - Authentication action required before the program can proceed [2023-07-17 16:26:00,363 - bdfr.oauth2 - WARNING] - Authenticate at https://www.reddit.com/api/v1/authorize?client_id=qo2gctMzJ0jUDULB2o97FQ&duration=permanent&redirect_uri=http%3A%2F%2Flocalhost%3A7634&response_type=code&scope=history+identity+read+mysubreddits+save&state=38960 Traceback (most recent call last): File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main return _run_code(code, main_globals, None, File "/usr/lib/python3.10/runpy.py", line 86, in _run_code exec(code, run_globals) File "/home/user1/.local/lib/python3.10/site-packages/bdfr/main.py", line 222, in cli() File "/usr/lib/python3/dist-packages/click/core.py", line 1128, in call return self.main(args, kwargs) File "/usr/lib/python3/dist-packages/click/core.py", line 1053, in main rv = self.invoke(ctx) File "/usr/lib/python3/dist-packages/click/core.py", line 1659, in invoke return _process_result(sub_ctx.command.invoke(sub_ctx)) File "/usr/lib/python3/dist-packages/click/core.py", line 1395, in invoke return ctx.invoke(self.callback, ctx.params) File "/usr/lib/python3/dist-packages/click/core.py", line 754, in invoke return __callback(args, *kwargs) File "/usr/lib/python3/dist-packages/click/decorators.py", line 26, in new_func return f(get_current_context(), args, kwargs) File "/home/user1/.local/lib/python3.10/site-packages/bdfr/main.py", line 117, in cli_download reddit_downloader = RedditDownloader(config, [stream]) File "/home/user1/.local/lib/python3.10/site-packages/bdfr/downloader.py", line 41, in init super(RedditDownloader, self).init(args, logging_handlers) File "/home/user1/.local/lib/python3.10/site-packages/bdfr/connector.py", line 63, in init self._setup_internal_objects() File "/home/user1/.local/lib/python3.10/site-packages/bdfr/connector.py", line 80, in _setup_internal_objects self.create_reddit_instance() File "/home/user1/.local/lib/python3.10/site-packages/bdfr/connector.py", line 144, in create_reddit_instance token = oauth2_authenticator.retrieve_new_token() File "/home/user1/.local/lib/python3.10/site-packages/bdfr/oauth2.py", line 67, in retrieve_new_token refresh_token = reddit.auth.authorize(params["code"]) File "/home/user1/.local/lib/python3.10/site-packages/praw/models/auth.py", line 54, in authorize authorizer.authorize(code) File "/home/user1/.local/lib/python3.10/site-packages/prawcore/auth.py", line 242, in authorize self._request_token( File "/home/user1/.local/lib/python3.10/site-packages/prawcore/auth.py", line 155, in _request_token response = self._authenticator._post(url, data) File "/home/user1/.local/lib/python3.10/site-packages/prawcore/auth.py", line 38, in _post raise ResponseException(response) prawcore.exceptions.ResponseException: received 500 HTTP response

slitchampion commented 1 year ago

I'm still getting 429s pretty quickly after setting that up and using --authenticate.

jameswebb07 commented 1 year ago

I'm still getting 429s pretty quickly after setting that up and using --authenticate.

follow this : https://github.com/aliparlakci/bulk-downloader-for-reddit/issues/910#issuecomment-1637165226

ErikLentz commented 1 year ago

Today I was getting 429s. Then I logged into Reddit in a browser (on a different PC, but same public IP) and the 429s stopped. Think this is intended by Reddit?

gemini0x2 commented 1 year ago

Definitely, reddit is limiting the rate of request. But if you use your own client_id and client_secret you should be good. Not sure why some people still get 429s.

Root-FTW commented 1 year ago

Definitely, reddit is limiting the rate of request. But if you use your own client_id and client_secret you should be good. Not sure why some people still get 429s.

Maybe they did not follow your instructions correctly, or they are not getting the my_config.cfg file correctly when running the script.

In my case the error 429 stopped appearing with your fix, so I confirm that your fix works perfect :D

I only get errors when the script encounters a twitter or youtube post I always get an error and it never downloads those videos, but I think that has always happened to me.

ErikLentz commented 1 year ago

I get the error below during the authentication part.

The auth part seems to work just fine on the reddit side, it's just gives this error 500 on the return.

I am running bdfr on a separate server and doing the auth on my desktop. I've done the same previously with other programs that use reddit api without issue though.

I'm seeing the same thing. Stuck here

markl181 commented 1 year ago

This did fix the 429 error for me, but I was still running into the endless hang issues reported in #911 (now closed which is why I'm commenting here). Ended up just giving up on what I was doing but just in case it helps anyone else.

Root-FTW commented 1 year ago

Definitely, reddit is limiting the rate of request. But if you use your own client_id and client_secret you should be good. Not sure why some people still get 429s.

Before the fix with the swcript I was getting approximately 100 videos (I run the script every 24 hours), with your fix I am getting only 20 videos or less, is there something in the custom .cfg file that can cause this?

gemini0x2 commented 1 year ago

Before the fix with the swcript I was getting approximately 100 videos (I run the script every 24 hours), with your fix I am getting only 20 videos or less, is there something in the custom .cfg file that can cause this?

I don't think the issue is related to the custom .cfg, as the only thing that changes from the default .cfg used by bdfr is the client_id and client_secret. Apart from that everything else remains the same.

WARl0-01 commented 1 year ago

for those who still see issues with BDFR after making an app in prefs

Try making a folder called 'configfiles' or something with no spaces in your localdisk folder
specify the path by adding --config (letter):(foldername)(file name).cfg to your bdfr command
also consider uninstalling and re-installing bdfr I both re-installed bdfr and used the no space folder before trying again so I can't attribute the fix to a specific one. I only write this because it solved my issues with it not working, versus me putting the config file in the bdfr folder under python foundation

happysmash27 commented 1 year ago

I still get some 429 errors when running as a personal use script (https://github.com/aliparlakci/bulk-downloader-for-reddit/issues/910#issuecomment-1637165226, using --config and a .cfg file in the same directory). Sometimes BDFR seems to stall, and whenever I notice that it has done nothing for a few hours, I will close and restart it, and use a small shell script to add back all the URLs with 429 errors back to BDFR to try again. But, some URLs, particularly on /r/AskReddit (probably due to large quantity of comments), seem to always throw 429 errors no matter how many times BDFR goes on them, for example, https://reddit.com/comments/oed06m, which has been ran several times at this point all with failure every single time. Shouldn't BDFR pause before sending the same request again, instead of giving up on the download and moving on to the next one?

Root-FTW commented 1 year ago

Windows 10:

Comnand used: bdfr download D:\Videos --opts fortnite.yaml --config my_config.cfg

Result:

Serene-Arc commented 1 year ago

@Root-FTW that's not the command that you used. The command that you used is ml --config my_config.cfg.

Root-FTW commented 1 year ago

@Root-FTW that's not the command that you used. The command that you used is ml --config my_config.cfg.

I'm sorry maybe I didn't explain correctly or rather, I didn't put everything in a complete way:

Months ago I created a .bat file which is executed daily in my windows every 24 hours, this is the .bat

when I finish running the script is when I get this message: 256398147-ef374fc7-8d5c-4c30-be57-9742fe80da9c

WARl0-01 commented 1 year ago

when I finish running the script is when I get this message

@Root-FTW you don't seem to be specifying the location of the configuration file. I think youve put rhe file into BDFRs working dir but id still specify the path. I'm not familiar with what "ml" does, but if it's saying it doesn't recognize it, then shouldn't you just remove it? Again: --config Letter:/path/to/file/filename.cfg

Apologies if this doesn't help

gemini0x2 commented 1 year ago

when I finish running the script is when I get this message:

Yep, definitely the issue is how you are executing your bdfr command. I'm not familiar with bat scripts, but as @WARl0-01 suggested try passing the absolute path to your .cfg, relative path doesn't seem to work in your case. If that does not solve your problem then mostly like the issue is your command syntax, you can try bdfr download "D:\Videos" --opts "fornite.yaml" --config "path/my_config.cfg"

Root-FTW commented 1 year ago

@Gavriik @WARl0-01 Thank you very much, your solution solved my problem perfectly, thank you.

Serene-Arc commented 1 year ago

I've pushed changes to the development branch that should hopefully fix this issue. There's an option in praw to extend the timeout. Hopefully that will fix the problem well enough.

Root-FTW commented 1 year ago

I've pushed changes to the development branch that should hopefully fix this issue. There's an option in praw to extend the timeout. Hopefully that will fix the problem well enough.

hello,

is it possible that this script can download videos only if they last 15 seconds or more?

I can't find a variable for that.

Serene-Arc commented 1 year ago

No, that isn't possible.

Root-FTW commented 1 year ago

No, that isn't possible.

I know this has nothing to do with this project, but it's the best project to get quality content fast and you are the only option I know of that could do something like what I'm looking for.

Is there any chance that this sccript will support tiktok in the future?

I mean I can put for example the hashtag #fortnite and it will bring me the latest videos from tiktok with the hashtag #fortnite, like it does with reddit but with tiktok.

Or if it will never support something like that, do you know of any project that can do that?

Serene-Arc commented 1 year ago

No, that isn't something that we can do. The BDFR is for Reddit specifically. It's possible that we could download Tiktok videos that are linked on Reddit but that's it.

Check out yt-dlp. That's what we use for most of the backend video links, they might be able to download specific Tiktok videos.

Root-FTW commented 1 year ago

No, that isn't something that we can do. The BDFR is for Reddit specifically. It's possible that we could download Tiktok videos that are linked on Reddit but that's it.

Check out yt-dlp. That's what we use for most of the backend video links, they might be able to download specific Tiktok videos.

Thanks for your answer, one last question, is it possible that I don't get this error?

It seems that sometimes it is found with twitter links that contain video like this: https://twitter.com/FortniteGame/status/1685440259209760768

And I get this error:

gemini0x2 commented 1 year ago

Thats simply the logging module doing its job, that part of the code is in bdfr/downloader.py. If you don't want to see that error you can try using the --skip-domain flag in your command. e.g bdfr download "D:\Videos" --opts "fornite.yaml" --config "path/my_config.cfg" --skip-domain "twitter.com"

twentyonerooms87 commented 1 year ago

Thanks to all the great comments I am back in business with subreddit downloads using BDFR. Many thanks to all.

Since I am now authenticating, I have not found a way to download posts from users. Does anyone have any tips? Thanks in advance! See below for example when I try to download posts from Limp-Plankton5931

C:\BDFR>c:\users\me\appdata\local\programs\python\python310\python -m bdfr download v:\bdfr\Limp-Plankton5931\ -L 65 --authenticate --config "c:\bdfr\my_config.cfg" --user Limp-Plankton5931 --no-dupes --verbose

[2023-08-14 13:42:13,502 - bdfr.connector - DEBUG] - Setting maximum download wait time to 120 seconds [2023-08-14 13:42:13,504 - bdfr.connector - DEBUG] - Setting datetime format string to ISO [2023-08-14 13:42:13,505 - bdfr.connector - DEBUG] - Disabling the following modules: [2023-08-14 13:42:13,510 - bdfr.connector - DEBUG] - Using authenticated Reddit instance Version 7.6.1 of praw is outdated. Version 7.7.1 was released Tuesday July 11, 2023. [2023-08-14 13:42:13,513 - root - INFO] - Program complete

Serene-Arc commented 1 year ago

Authentication shouldn't disrupt the process in any way of downloading other users. You need to specify what from them that you want to download, such as using the --submitted flag.

Serene-Arc / bulk-downloader-for-reddit