kieraneglin / pinchflat

Your next YouTube media manager
GNU Affero General Public License v3.0
776 stars 16 forks source link

[Triage] Stuck pending downloads #331

Closed Iliannnn closed 1 month ago

Iliannnn commented 1 month ago

Describe the bug I have two pending downloads that won't download, not even when you force download them. Logs will be below.

Diagnostic info

- App Version: 2024.7.18
- yt-dlp Version: 2024.07.16
- Apprise Version: v1.8.0
- System Architecture: x86_64-pc-linux-gnu
- Timezone: Europe/Brussels

Additional context

2024-07-25 22:10:44.678 [error] | [command_wrapper]: /usr/local/bin/yt-dlp called with: https://www.youtube.com/watch?v=N023C6KgHcg --no-simulate --no-progress --no-force-overwrites --parse-metadata %(upload_date>%Y-%m-%d)s:(?P<meta_date>.+) --write-auto-subs --write-subs --convert-subs srt --embed-subs --sub-langs en --write-thumbnail --convert-thumbnail jpg --output thumbnail:/downloads/shows/The Tren Twins/Season %(upload_date>%Y)S/s%(upload_date>%Y)Se%(upload_date>%m%d)S99 - %(title)S-thumb.%(ext)S --embed-thumbnail --convert-thumbnail jpg --write-info-json --clean-info-json --embed-metadata --remux-video mp4 --format-sort res:4320,+codec:avc:m4a --output /downloads/shows/The Tren Twins/Season %(upload_date>%Y)S/s%(upload_date>%Y)Se%(upload_date>%m%d)S99 - %(title)S.%(ext)S --print-to-file after_move:%()j /tmp/pinchflat/data/dc86ccc709604a55fd135769a2e409e137100157bd660ede8fb61eec5a9444e0.json --windows-filenames --quiet --cache-dir /tmp/pinchflat/data/yt-dlp-cache exited: 1 with: ERROR: [youtube] N023C6KgHcg: Sign in to confirm you’re not a bot. This helps protect our community. Learn more

    all values are hidden

2024-07-25 22:10:44.678 [error] | yt-dlp download error for media item #733: "ERROR: [youtube] N023C6KgHcg: Sign in to confirm you’re not a bot. This helps protect our community. Learn more\n"
2024-07-25 22:10:45.820 [error] | [command_wrapper]: /usr/local/bin/yt-dlp called with: https://www.youtube.com/watch?v=AAMvAwCUtRA --no-simulate --no-progress --no-force-overwrites --parse-metadata %(upload_date>%Y-%m-%d)s:(?P<meta_date>.+) --write-auto-subs --write-subs --convert-subs srt --embed-subs --sub-langs en --write-thumbnail --convert-thumbnail jpg --output thumbnail:/downloads/shows/The Tren Twins/Season %(upload_date>%Y)S/s%(upload_date>%Y)Se%(upload_date>%m%d)S99 - %(title)S-thumb.%(ext)S --embed-thumbnail --convert-thumbnail jpg --write-info-json --clean-info-json --embed-metadata --remux-video mp4 --format-sort res:4320,+codec:avc:m4a --output /downloads/shows/The Tren Twins/Season %(upload_date>%Y)S/s%(upload_date>%Y)Se%(upload_date>%m%d)S99 - %(title)S.%(ext)S --print-to-file after_move:%()j /tmp/pinchflat/data/090ce27a2a68e88eb605cf53dfd75462303e4049baf81cabe268f636ddbd2661.json --windows-filenames --quiet --cache-dir /tmp/pinchflat/data/yt-dlp-cache exited: 1 with: ERROR: [youtube] AAMvAwCUtRA: Sign in to confirm you’re not a bot. This helps protect our community. Learn more

    all values are hidden

2024-07-25 22:10:45.821 [error] | yt-dlp download error for media item #731: "ERROR: [youtube] AAMvAwCUtRA: Sign in to confirm you’re not a bot. This helps protect our community. Learn more\n"
Iliannnn commented 1 month ago

After some googling it looks like YouTube is doing some heavy restrictions on database IPs, including my Hetzner IP I am hosting Pinchflat on. Seems like I will have to proxy my IP or use a VPN...

Maybe support for a plugin like this would also help: https://github.com/coletdjnz/yt-dlp-youtube-oauth2

kieraneglin commented 1 month ago

Yeah, YouTube has been going nuclear on shared IPs lately. It's very frustrating.

I've looked into that plugin in the past but last I heard it doesn't actually improve your chance of dodging a rate-limit. Granted, I heard that when the situation was still very fresh so I'll dig back in to see if the maintainer's recommendations have changed.

Iliannnn commented 1 month ago

I'm currently on vacation, but when I get home I'll check if hooking up my Pinchflat instance to my VPN makes any difference. Hoping YouTube doesn't also block that since technically it's a datacenter as well.

Iliannnn commented 1 month ago

Seems like YouTube changed their mind because it randomly downloaded the pending downloads I had.

Iliannnn commented 1 month ago

Seems like YouTube changed their mind because it randomly downloaded the pending downloads I had.

They didn't. I mistakenly thought they did because I got a notification about new media being downloaded. However, after double-checking, it turns out nothing was actually downloaded. Strange. I'll try using a VPN now.

Iliannnn commented 1 month ago

Putting Pinchflat behind a VPN using Gluetun fixes this problem.

kieraneglin commented 1 month ago

Thank you for continuing to follow up on this! yt-dlp specifically has gotten some bad press lately from that one Nvidia leak so it's good to see there are still workarounds