search

ytdl-org / youtube-dl

Command-line program to download videos from YouTube.com and other video sites
http://ytdl-org.github.io/youtube-dl/
The Unlicense
131.39k stars 9.96k forks source link

Some playable yt vids fail with Error: Did not get any data blocks or 404 #29672

Open Je55eah opened 3 years ago

Je55eah commented 3 years ago

Checklist

Description

WRITE DESCRIPTION HERE

Some playable yt vids fail with Error: Did not get any data blocks or 404

These videos specifically

https://youtube.com/watch?v=EF6RJESEBEU https://youtube.com/watch?v=puEposJa9xc https://youtube.com/watch?v=P5Oi_F-SRFM https://youtube.com/watch?v=ksZ6SFTY6Dk https://youtube.com/watch?v=AAfUqbWK6Sc https://youtube.com/watch?v=nzey0glI74o https://youtube.com/watch?v=xDKth-qS8Jk

It's only a few so I will attempt to use an alternative downloader, but it is an issue that may concern you.

I am using the windows executable which I downloaded about a week ago.

rautamiekka commented 3 years ago

Don't skip the template, it's there for a reason.

Je55eah commented 3 years ago

supportLetter1.bat.txt batch-file.txt log.txt supportLetter1.txt

Where is the template?

Je55eah commented 3 years ago

I found the template. It didn't render when I submitted the initial report. OP has been updated.

dirkf commented 3 years ago

https://youtube.com/watch?v=EF6RJESEBEU worked for me delivering format 137+140, 122MB.

If that doesn't work for you, you can create a 'Broken Site Support' issue and follow the template as suggested.

Je55eah commented 3 years ago

Is there still a problem with the template? I discovered these when using -f best on a playlist of thousands of videos. Is your suggestion that I should manually try various formats on each failed video until one of them is successful?

dirkf commented 3 years ago

If you followed the Broken Site Support template you would see that it asks you for a verbose log of the failure being reported, etc.

The one that succeeded for me, using the program default for -f, combined these formats:

137          mp4        1920x1080  1080p 1981k , mp4_dash container, avc1.640028@1981k, 30fps, video only, 121.95MiB
140          m4a        audio only tiny  129k , m4a_dash container, mp4a.40.2@129k (44100Hz), 7.97MiB
Je55eah commented 3 years ago

I already posted the verbose log. It is log.txt above.

dirkf commented 3 years ago

'verbose' means running with --verbose or -v, like this:

$ youtube-dl -v 'https://youtube.com/watch?v=EF6RJESEBEU'
[debug] System config: ['--prefer-ffmpeg']
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-v', 'https://youtube.com/watch?v=EF6RJESEBEU']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2021.06.06
[debug] Python version 3.5.2 (CPython) - Linux-4.4.0-210-generic-i686-with-Ubuntu-16.04-xenial
[debug] exe versions: avconv 4.3, avprobe 4.3, ffmpeg 4.3, ffprobe 4.3
[debug] Proxy map: {}
[youtube] EF6RJESEBEU: Downloading webpage
[debug] Default format spec: bestvideo+bestaudio/best
[debug] Invoking downloader on 'https://r1---sn-cu-aigsl.googlevideo.com/videoplayback?expire=1627545923&ei=4wwCYdreI6bAmLAP_s2H2Ag&ip=46.208.6.33&id=o-AEu8x4JufbNn9E1VBJdI4RSrVdcBUR-WxjfIVQvCC9oI&itag=137&aitags=133%2C134%2C135%2C136%2C137%2C160%2C242%2C243%2C244%2C247%2C248%2C278%2C394%2C395%2C396%2C397%2C398%2C399&source=youtube&requiressl=yes&mh=XG&mm=31%2C29&mn=sn-cu-aigsl%2Csn-cu-c9il&ms=au%2Crdu&mv=m&mvi=1&pl=25&initcwndbps=1026250&vprv=1&mime=video%2Fmp4&ns=VC99aypYcVlHuTif5m-3EOQG&gir=yes&clen=127874421&dur=516.182&lmt=1604205810100752&mt=1627524080&fvip=7&keepalive=yes&fexp=24001373%2C24007246&c=WEB&txp=5535432&n=urM2qYbikVowtFg&sparams=expire%2Cei%2Cip%2Cid%2Caitags%2Csource%2Crequiressl%2Cvprv%2Cmime%2Cns%2Cgir%2Cclen%2Cdur%2Clmt&sig=AOq0QJ8wRQIgYbddCo_yEcjFzku5Opvp-qRGVYU7s66rTt7TFXaIpSsCIQDaic86QpR8xYdiVLyjNHRB1pt_ML3gswHGmnuuKlTuoQ%3D%3D&lsparams=mh%2Cmm%2Cmn%2Cms%2Cmv%2Cmvi%2Cpl%2Cinitcwndbps&lsig=AG3C_xAwRQIhAKiwwnmsnrxOrhzwYFceyDiDj8EK8ugGkYwfjrqQgHQsAiBjpy-d-ifCkliuNSX2sgujJZG_xMqQpc6fLf9EH-3q8A%3D%3D'
[download] Destination: How Chile Finally Scrapped Its Dictator-Era Constitution-EF6RJESEBEU.f137.mp4
[download] 100% of 121.95MiB in 01:51
[debug] Invoking downloader on 'https://r1---sn-cu-aigsl.googlevideo.com/videoplayback?expire=1627545923&ei=4wwCYdreI6bAmLAP_s2H2Ag&ip=46.208.6.33&id=o-AEu8x4JufbNn9E1VBJdI4RSrVdcBUR-WxjfIVQvCC9oI&itag=140&source=youtube&requiressl=yes&mh=XG&mm=31%2C29&mn=sn-cu-aigsl%2Csn-cu-c9il&ms=au%2Crdu&mv=m&mvi=1&pl=25&initcwndbps=1026250&vprv=1&mime=audio%2Fmp4&ns=VC99aypYcVlHuTif5m-3EOQG&gir=yes&clen=8355616&dur=516.249&lmt=1604203795069029&mt=1627524080&fvip=7&keepalive=yes&fexp=24001373%2C24007246&c=WEB&txp=5531432&n=urM2qYbikVowtFg&sparams=expire%2Cei%2Cip%2Cid%2Citag%2Csource%2Crequiressl%2Cvprv%2Cmime%2Cns%2Cgir%2Cclen%2Cdur%2Clmt&sig=AOq0QJ8wRAIgJmWwM01Z16ArH8iSLxgBxRR0WZPhQLIfKRNeAuA3AjkCIGpX7v5ZDpxupAMjwDwKSkDOEkNo5-Lalnz2ZyWjG0-A&lsparams=mh%2Cmm%2Cmn%2Cms%2Cmv%2Cmvi%2Cpl%2Cinitcwndbps&lsig=AG3C_xAwRQIhAKiwwnmsnrxOrhzwYFceyDiDj8EK8ugGkYwfjrqQgHQsAiBjpy-d-ifCkliuNSX2sgujJZG_xMqQpc6fLf9EH-3q8A%3D%3D'
[download] Destination: How Chile Finally Scrapped Its Dictator-Era Constitution-EF6RJESEBEU.f140.m4a
[download] 100% of 7.97MiB in 00:07
[ffmpeg] Merging formats into "How Chile Finally Scrapped Its Dictator-Era Constitution-EF6RJESEBEU.mp4"
[debug] ffmpeg command line: ffmpeg -y -loglevel repeat+info -i 'file:How Chile Finally Scrapped Its Dictator-Era Constitution-EF6RJESEBEU.f137.mp4' -i 'file:How Chile Finally Scrapped Its Dictator-Era Constitution-EF6RJESEBEU.f140.m4a' -c copy -map 0:v:0 -map 1:a:0 'file:How Chile Finally Scrapped Its Dictator-Era Constitution-EF6RJESEBEU.temp.mp4'
Deleting original file How Chile Finally Scrapped Its Dictator-Era Constitution-EF6RJESEBEU.f137.mp4 (pass -k to keep)
Deleting original file How Chile Finally Scrapped Its Dictator-Era Constitution-EF6RJESEBEU.f140.m4a (pass -k to keep)
$
Je55eah commented 3 years ago

I did, and the output of that command is in log.txt.

edit: I see that now this issue report has been downvoted...

Although the main page instructs us to post the verbose log in a file I'll post it here as well. If you want a suggested solution, these failures should failover to an alternate setting that works without user intervention.

youtube-dl is up-to-date (2021.06.06) [youtube] EF6RJESEBEU: Downloading webpage [info] Writing video description to: L:\Sorted\Videos\VICE_News - 20201027 - How_Chile_Finally_Scrapped_Its_Dictator-Era_Constitution - EF6RJESEBEU.description [debug] Invoking downloader on 'https://r1---sn-5pgnugx5h-hn2z.googlevideo.com/videoplayback?expire=1627532956&ei=PNoBYbODFofUuQLLmJHYDA&ip=98.143.227.101&id=o-APCgoyO19BANHVNPsho2JgqoJUmmPAmxL7dH4xEShpKs&itag=22&source=youtube&requiressl=yes&mh=XG&mm=31%2C29&mn=sn-5pgnugx5h-hn2z%2Csn-vgqsknll&ms=au%2Crdu&mv=m&mvi=1&pl=20&ctier=A&pfa=5&initcwndbps=1298750&hightc=yes&vprv=1&mime=video%2Fmp4&ns=rVqzSZJMRCGuX7xsFxyLJMQG&cnr=14&ratebypass=yes&dur=516.249&lmt=1604205856142789&mt=1627510368&fvip=1&fexp=24001373%2C24007246&beids=24064827&c=WEB&txp=5535432&n=2iJN04g8Zcw0gtA&sparams=expire%2Cei%2Cip%2Cid%2Citag%2Csource%2Crequiressl%2Cctier%2Cpfa%2Chightc%2Cvprv%2Cmime%2Cns%2Ccnr%2Cratebypass%2Cdur%2Clmt&sig=AOq0QJ8wRAIfCN115appJVB2dKj0PbO_cwR4LBwjjpeAfUYw5xb62AIhAJZeAOnwieroTyk5sysyG1QB2-qPlmCf58Go6AxUGhVA&lsparams=mh%2Cmm%2Cmn%2Cms%2Cmv%2Cmvi%2Cpl%2Cinitcwndbps&lsig=AG3C_xAwRQIhAN3oeZvB-8a-3cBkTxKYRyjdMG5-KWQQYjCvP6Bpgj9HAiA2ylfdA320pVjXRoLbBkGXXlAI5Z6vZ-4ebAMNzfg_Gg%3D%3D' [download] Resuming download at byte 202931

[youtube] puEposJa9xc: Downloading webpage [info] Writing video description to: L:\Sorted\Videos\Michael_Invests_tries_to_make_Money - 20210325 - Ray_Dalio_Warns_Big_Housing_Stock_Market_Crash_Coming_From_Hyperinflation_Or_Rising_Interest_Rates - puEposJa9xc.description [debug] Invoking downloader on 'https://r1---sn-5pgnugx5h-hn2l.googlevideo.com/videoplayback?expire=1627532958&ei=PtoBYaT7Eor6uQLZsqO4Aw&ip=98.143.227.101&id=o-AArfbSTHNFeNEus3dMJ3VRIJftC1oa7ce_84cL9Zsyov&itag=22&source=youtube&requiressl=yes&mh=I-&mm=31%2C29&mn=sn-5pgnugx5h-hn2l%2Csn-vgqsknll&ms=au%2Crdu&mv=m&mvi=1&pl=20&ctier=A&pfa=5&initcwndbps=1301250&hightc=yes&vprv=1&mime=video%2Fmp4&ns=KaR47YIXUw5Vwq7Lb_PG04cG&cnr=14&ratebypass=yes&dur=1132.901&lmt=1616687367279446&mt=1627510368&fvip=4&fexp=24001373%2C24007246&beids=24064827&c=WEB&txp=5432432&n=-cV1lC5lTwVonG3&sparams=expire%2Cei%2Cip%2Cid%2Citag%2Csource%2Crequiressl%2Cctier%2Cpfa%2Chightc%2Cvprv%2Cmime%2Cns%2Ccnr%2Cratebypass%2Cdur%2Clmt&sig=AOq0QJ8wRgIhAOgS4SiUDgZPi3CZK5o22J1sF-e-tVS11FOs9u3p-txPAiEAk0P_qPxKmeLahmHp5n55whUC0uxLJImnPSfotlHB1oc%3D&lsparams=mh%2Cmm%2Cmn%2Cms%2Cmv%2Cmvi%2Cpl%2Cinitcwndbps&lsig=AG3C_xAwRQIgAs23LuMSZsBV-TqryDtDlBxL1aGcpff7qlL1tGcMXaICIQD5HbFVNESbBWx1zlRqtqxJqutJDbcB1ngKu6lKai7Wnw%3D%3D' [download] Resuming download at byte 530376

[youtube] P5Oi_F-SRFM: Downloading webpage [youtube] P5Oi_F-SRFM: Downloading MPD manifest [info] Writing video description to: L:\Sorted\Videos\Homestead_Roofing_Inc - 20201204 - Asphalt_Shingle_vs_Metal_Roofing_After_Huge_Colorado_Springs_Hail - P5Oi_F-SRFM.description [debug] Invoking downloader on 'https://r1---sn-5pgnugx5h-hn2z.googlevideo.com/videoplayback?expire=1627532960&ei=QNoBYc2QAYr6uwL95bWYCA&ip=98.143.227.101&id=o-AJV416piwN9s2ZLP6gVqOIf6-vU1U4m_Kr39YpQ5KdIX&itag=22&source=youtube&requiressl=yes&mh=PJ&mm=31%2C29&mn=sn-5pgnugx5h-hn2z%2Csn-vgqsrned&ms=au%2Crdu&mv=m&mvi=1&pl=20&ctier=A&pfa=5&initcwndbps=1298750&hightc=yes&vprv=1&mime=video%2Fmp4&ns=TuxdMVZL02jb6B0m9mS1WS4G&cnr=14&ratebypass=yes&dur=436.837&lmt=1607047001370254&mt=1627510368&fvip=1&fexp=24001373%2C24007246&beids=24064827&c=WEB&txp=6211222&n=754NEZ7VAvhr6xm&sparams=expire%2Cei%2Cip%2Cid%2Citag%2Csource%2Crequiressl%2Cctier%2Cpfa%2Chightc%2Cvprv%2Cmime%2Cns%2Ccnr%2Cratebypass%2Cdur%2Clmt&sig=AOq0QJ8wRQIgaFYKY-WYUznDd0H16qrx3cT7IVlRsF35vlbEw_gm5NECIQDNxwvQhn1HvXfCI2KlH8G2X5yDJMdM4Fkw5z4izGXVTg%3D%3D&lsparams=mh%2Cmm%2Cmn%2Cms%2Cmv%2Cmvi%2Cpl%2Cinitcwndbps&lsig=AG3C_xAwRQIgWQAj3X-VKGxJxRvn80l31B6WRwbCVO1iut078MYXOoMCIQDJoxVzhXK3Vx_RTXsAsbMuXjrPml92AtrogHE6iAU9tg%3D%3D' [download] Resuming download at byte 141763

[youtube] ksZ6SFTY6Dk: Downloading webpage [info] Writing video description to: L:\Sorted\Videos\Study_of_Antiquity_and_the_Middle_Ages - 20210105 - Greek_and_Roman_Sources_on_Ancient_Africa - ksZ6SFTY6Dk.description [debug] Invoking downloader on 'https://r1---sn-5pgnugx5h-hn2z.googlevideo.com/videoplayback?expire=1627532961&ei=QdoBYe_HLsPauQKhhr2wBg&ip=98.143.227.101&id=o-APDpKvEUIt6H8mpBWfEKOzzspRD2EwoyoedwUVBow9l4&itag=22&source=youtube&requiressl=yes&mh=v9&mm=31%2C29&mn=sn-5pgnugx5h-hn2z%2Csn-vgqsknek&ms=au%2Crdu&mv=m&mvi=1&pl=20&ctier=A&pfa=5&initcwndbps=1298750&hightc=yes&vprv=1&mime=video%2Fmp4&ns=Ivjev7bhDz8UH2cpViSOBI4G&cnr=14&ratebypass=yes&dur=2632.562&lmt=1609877559437995&mt=1627510368&fvip=1&fexp=24001373%2C24007246&beids=24064827&c=WEB&txp=5416222&n=KvW1iumyDdmW-Gb&sparams=expire%2Cei%2Cip%2Cid%2Citag%2Csource%2Crequiressl%2Cctier%2Cpfa%2Chightc%2Cvprv%2Cmime%2Cns%2Ccnr%2Cratebypass%2Cdur%2Clmt&sig=AOq0QJ8wRQIgB1uoxSu7wm4qOBQFBx0wsNdsFkPKYMD6Q6Oc3nybkaQCIQCMYDKfir1Pi8p5QFKcg3IleB4Ra82vU9GRNufG-QWlyA%3D%3D&lsparams=mh%2Cmm%2Cmn%2Cms%2Cmv%2Cmvi%2Cpl%2Cinitcwndbps&lsig=AG3C_xAwRQIhAKmNy2Fv0o8NMpKkcmKkd_jgqCfu5Cgq8VQjtN7RLOCpAiASqP58z4kDIQbBkvKpyQ-x6-VYuVu-PZqi65RPN874RA%3D%3D' [download] Resuming download at byte 1084363

[youtube] AAfUqbWK6Sc: Downloading webpage [info] Writing video description to: L:\Sorted\Videos\Mine_Explorers - 20160913 - Detailed_Tour_Of_A_Small_Gold_Mine - AAfUqbWK6Sc.description [debug] Invoking downloader on 'https://r1---sn-5pgnugx5h-hn2z.googlevideo.com/videoplayback?expire=1627532963&ei=Q9oBYaXyHsfClu8PmLOIyAU&ip=98.143.227.101&id=o-AMW7V_fdCeA6sNjKb3NgmjqUIWN96aFYsZzJOkNqas18&itag=22&source=youtube&requiressl=yes&mh=Xl&mm=31%2C29&mn=sn-5pgnugx5h-hn2z%2Csn-vgqsrnes&ms=au%2Crdu&mv=m&mvi=1&pl=20&ctier=A&pfa=5&initcwndbps=1298750&hightc=yes&vprv=1&mime=video%2Fmp4&ns=0wjdnCuQA2cbtwDytxcc5pYG&cnr=14&ratebypass=yes&dur=2838.848&lmt=1609015219071741&mt=1627510368&fvip=3&fexp=24001373%2C24007246&beids=24064827&c=WEB&txp=5511222&n=F6qPz7BVy3ohiMo&sparams=expire%2Cei%2Cip%2Cid%2Citag%2Csource%2Crequiressl%2Cctier%2Cpfa%2Chightc%2Cvprv%2Cmime%2Cns%2Ccnr%2Cratebypass%2Cdur%2Clmt&sig=AOq0QJ8wRgIhAMgdB1TTQuMvhpFlRelwQuJBVrAlc0FMqw853As9YhFoAiEAgjSdNhZEVkd5SzXyvmC4qOIQSewfhZKhP5-GGVdVFiU%3D&lsparams=mh%2Cmm%2Cmn%2Cms%2Cmv%2Cmvi%2Cpl%2Cinitcwndbps&lsig=AG3C_xAwRQIgdhZO_F3ahv8U81E87UvpGd3Hb5rS1jxcw9nt0roKtaUCIQD9_xqwBjlrOnT4iAWnY5OjSx6k8nzpTYyXoBVQnaaO7Q%3D%3D' [download] Resuming download at byte 1372612

[youtube] nzey0glI74o: Downloading webpage [info] Writing video description to: L:\Sorted\Videos\Coffeezilla - 20201203 - 90s_Get_Rich_Quick_Schemes_Are_INSANE - nzey0glI74o.description [debug] Invoking downloader on 'https://r2---sn-5pgnugx5h-hn2s.googlevideo.com/videoplayback?expire=1627532965&ei=RNoBYei1N_HAlu8PgoWFwAo&ip=98.143.227.101&id=o-AADBEL4LqPW6RL3sVDcUY5jYUTa-5VOPiEQHS_LF7Abi&itag=22&source=youtube&requiressl=yes&mh=2l&mm=31%2C29&mn=sn-5pgnugx5h-hn2s%2Csn-vgqs7nly&ms=au%2Crdu&mv=m&mvi=2&pl=20&ctier=A&pfa=5&initcwndbps=1383750&hightc=yes&vprv=1&mime=video%2Fmp4&ns=ySs1cYB7rYyDrS6iXBMQHjwG&cnr=14&ratebypass=yes&dur=717.101&lmt=1607064765351803&mt=1627510368&fvip=6&fexp=24001373%2C24007246&beids=24064827&c=WEB&txp=5516222&n=q73Lzc8mHFlpQVn&sparams=expire%2Cei%2Cip%2Cid%2Citag%2Csource%2Crequiressl%2Cctier%2Cpfa%2Chightc%2Cvprv%2Cmime%2Cns%2Ccnr%2Cratebypass%2Cdur%2Clmt&sig=AOq0QJ8wRQIgAzBn-Q23VFuvHvksqHm1U-AjFfBPVFmGC-UzMgUL6UoCIQDZotU9OgHxSn3a6pNeHytNFSjEE4AkHacoogCCKH8XjA%3D%3D&lsparams=mh%2Cmm%2Cmn%2Cms%2Cmv%2Cmvi%2Cpl%2Cinitcwndbps&lsig=AG3C_xAwRQIhANe5M_cPC21dXpJtJW8F9tvTyBoXgNGwgjuQDUKPnw9YAiAzXOGxunxdu_JdF_4yarsvzcvxwXaueAIg8HxITcLh3Q%3D%3D' [download] Resuming download at byte 434796 [youtube] xDKth-qS8Jk: Downloading webpage [info] Writing video description to: L:\Sorted\Videos\TED - 20190905 - The_new_political_story_that_could_change_everything_George_Monbiot - xDKth-qS8Jk.description [debug] Invoking downloader on 'https://r2---sn-5pgnugx5h-hn2z.googlevideo.com/videoplayback?expire=1627532966&ei=RtoBYcCRCpGw6QKegbzIBQ&ip=98.143.227.101&id=o-ALYcyPEHS1OD_6_s2CSDeYPB8yJY0ftHgN67bEbpMmhB&itag=22&source=youtube&requiressl=yes&mh=ne&mm=31%2C29&mn=sn-5pgnugx5h-hn2z%2Csn-vgqsknly&ms=au%2Crdu&mv=m&mvi=2&pcm2cms=yes&pl=20&ctier=A&pfa=5&initcwndbps=1298750&hightc=yes&vprv=1&mime=video%2Fmp4&ns=iSwlynCghMOmurBkk7UIxfgG&cnr=14&ratebypass=yes&dur=915.539&lmt=1564102385814928&mt=1627510368&fvip=2&fexp=24001373%2C24007246&beids=24064827&c=WEB&txp=4432432&n=Oly8wcZJokSKJuy&sparams=expire%2Cei%2Cip%2Cid%2Citag%2Csource%2Crequiressl%2Cctier%2Cpfa%2Chightc%2Cvprv%2Cmime%2Cns%2Ccnr%2Cratebypass%2Cdur%2Clmt&sig=AOq0QJ8wRQIhAI3zPDRkDV2c6diAfkBOIaAg2iHUN1eXb19G8ur89HYwAiBSCDKNMIZGhAlDReTtAlep4aErxnB8SKWcUiaeJd7-_w%3D%3D&lsparams=mh%2Cmm%2Cmn%2Cms%2Cmv%2Cmvi%2Cpcm2cms%2Cpl%2Cinitcwndbps&lsig=AG3C_xAwRAIgJCIlUIErzEZ017JorGrkMPCZjOs16iJwPN6UfnFWySQCIHVfYHNnZ9r9nZ-bqmKnTc7-YRKIiUz7xMdGp8B7fB_P' [download] Resuming download at byte 466400 Finished

dirkf commented 3 years ago

It should be clear in comparison with the example I showed that somehow your verbose output is incomplete. Maybe you are only capturing the standard output? In Windows cmd as in a POSIX shell, you can append 2>&1 to merge standard error into standard output.

Je55eah commented 3 years ago

I ran it again without the ignore errors argument and dumped 2>&1 into the output as well.

youtube-dl is up-to-date (2021.06.06) [debug] System config: [] [debug] User config: [] [debug] Custom config: [] [debug] Command-line args: ['-v', '-f', 'best', '--restrict-filenames', '--write-description', '--cookies', 'cookies.txt', '--download-archive', 'L:\Sorted\Videos\download-archive.txt', '--batch-file', 'L:\Sorted\Videos\batch-file.txt', '-o', 'L:\Sorted\Videos\%(uploader)s - %(upload_date)s - %(title)s - %(id)s.%(ext)s', ''] [debug] Batch file urls: ['https://youtube.com/watch?v=EF6RJESEBEU', 'https://youtube.com/watch?v=puEposJa9xc', 'https://youtube.com/watch?v=P5Oi_F-SRFM', 'https://youtube.com/watch?v=ksZ6SFTY6Dk', 'https://youtube.com/watch?v=AAfUqbWK6Sc', 'https://youtube.com/watch?v=nzey0glI74o', 'https://youtube.com/watch?v=xDKth-qS8Jk'] [debug] Encodings: locale cp1252, fs mbcs, out cp1252, pref cp1252 [debug] youtube-dl version 2021.06.06 [debug] Python version 3.4.4 (CPython) - Windows-7-6.1.7601-SP1 [debug] exe versions: none [debug] Proxy map: {} [youtube] EF6RJESEBEU: Downloading webpage [info] Writing video description to: L:\Sorted\Videos\VICE_News - 20201027 - How_Chile_Finally_Scrapped_Its_Dictator-Era_Constitution - EF6RJESEBEU.description [debug] Invoking downloader on 'https://r1---sn-5pgnugx5h-hn2z.googlevideo.com/videoplayback?expire=1627705545&ei=aHwEYfT3NZmLlu8P5r2zeA&ip=98.143.227.101&id=o-AGD4m_mEwqfLVa3iOqfVy1KE7pdfuByulW2qU-0Xcxke&itag=22&source=youtube&requiressl=yes&mh=XG&mm=31%2C29&mn=sn-5pgnugx5h-hn2z%2Csn-vgqsknll&ms=au%2Crdu&mv=m&mvi=1&pcm2cms=yes&pl=20&ctier=A&pfa=5&initcwndbps=1255000&hightc=yes&vprv=1&mime=video%2Fmp4&ns=lJb9aO7HnTOTcKwjpUTIyWkG&cnr=14&ratebypass=yes&dur=516.249&lmt=1604205856142789&mt=1627683668&fvip=1&fexp=24001373%2C24007246&beids=24064827&c=WEB&txp=5535432&n=VJDJOZkeOySLkyGMk&sparams=expire%2Cei%2Cip%2Cid%2Citag%2Csource%2Crequiressl%2Cctier%2Cpfa%2Chightc%2Cvprv%2Cmime%2Cns%2Ccnr%2Cratebypass%2Cdur%2Clmt&sig=AOq0QJ8wRQIgenLeRopWCR2U3YU7S5FLbtAHzRTxo97fxotQnWwBlAoCIQDGpaBHW8cpTXxTTCDwk8lkSvB32VNzssUXXJMh_7uC7g%3D%3D&lsparams=mh%2Cmm%2Cmn%2Cms%2Cmv%2Cmvi%2Cpcm2cms%2Cpl%2Cinitcwndbps&lsig=AG3C_xAwRAIgAkQWv7UEb_1qt955rXPnClcta20OJQu6gj6Tp9OQWyACICTKJ-42YQPU31GylAI_rIuUl5O31zPpQq5NIIJREKZJ' [download] Resuming download at byte 202931

ERROR: Did not get any data blocks File "main.py", line 19, in File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpkqxnwl31\build\youtube_dl__init.py", line 475, in main File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpkqxnwl31\build\youtube_dl__init__.py", line 465, in _real_main File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpkqxnwl31\build\youtube_dl\YoutubeDL.py", line 2069, in download File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpkqxnwl31\build\youtube_dl\YoutubeDL.py", line 808, in extract_info File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpkqxnwl31\build\youtube_dl\YoutubeDL.py", line 815, in wrapper File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpkqxnwl31\build\youtube_dl\YoutubeDL.py", line 847, in extract_info File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpkqxnwl31\build\youtube_dl\YoutubeDL.py", line 881, in process_ie_result File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpkqxnwl31\build\youtube_dl\YoutubeDL.py", line 1692, in process_video_result File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpkqxnwl31\build\youtube_dl\YoutubeDL.py", line 1976, in process_info File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpkqxnwl31\build\youtube_dl\YoutubeDL.py", line 1915, in dl File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpkqxnwl31\build\youtube_dl\downloader\common.py", line 366, in download File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpkqxnwl31\build\youtube_dl\downloader\http.py", line 352, in real_download File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpkqxnwl31\build\youtube_dl\downloader\http.py", line 322, in download File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpkqxnwl31\build\youtube_dl\downloader\common.py", line 165, in report_error File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpkqxnwl31\build\youtube_dl\YoutubeDL.py", line 628, in report_error File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpkqxnwl31\build\youtube_dl\YoutubeDL.py", line 590, in trouble

Finished

erus commented 3 years ago

Same issue here : latest version from git, trying to download https://www.youtube.com/watch?v=F_VU26hqNfQ gives the following result. ytdl-log.txt

dirkf commented 3 years ago

I tested that URL with the native downloader (twice) and also with --external-downloader wget and --external-downloader ffmpeg. The native downloader failed once with 'ERROR: Did not get any data blocks' while the others didn't.

From the linked log above, as well as the one I observed, this is what is happening:

One might think that this condition should be trapped and retried, but perhaps there is a good reason for the existing error handling structure.

For instance, replace ll.250-4 by

                data_read_len = len(data_block)
                if data_read_len == 0:
                    # detect missing data if we can
                    if data_len is not None and data_len < byte_counter:
                        retry('short read: length 0')
                    # exit loop when download is finished
                    break

                byte_counter += data_read_len

With this change there would be 10 retries by default. Whether this would solve the issue (which I guess is a server fault) is not clear.

BrianGenisio commented 2 years ago

I'm running into the same problem (ERROR: Did not get any data blocks) on video ID Z2GD_BJoFPY. I tried the above script change in http.py but it didn't do anything because data_len was larger than byte_counter.

> ./__main__.py Z2GD_BJoFPY -v
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'Z2GD_BJoFPY', u'-v']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2021.06.06
[debug] Git HEAD: dde6dd6
[debug] Python version 2.7.17 (CPython) - Darwin-20.6.0-x86_64-i386-64bit
[debug] exe versions: none
[debug] Proxy map: {}
[youtube] Z2GD_BJoFPY: Downloading webpage
[debug] Default format spec: best/bestvideo+bestaudio
[debug] Invoking downloader on u'https://r1---sn-vgqs7ns7.googlevideo.com/videoplayback?expire=1637343985&ei=kY6XYb6rMMSU2_gPk_6SiA8&ip=75.46.42.73&id=o-AEJnLQhQHSE7dLLpR4ZOKN7aCJbDN8E8DAVETZMIrCpJ&itag=22&source=youtube&requiressl=yes&mh=BZ&mm=31%2C29&mn=sn-vgqs7ns7%2Csn-vgqsknes&ms=au%2Crdu&mv=m&mvi=1&pl=21&initcwndbps=1135000&vprv=1&mime=video%2Fmp4&ns=-oPwCXmNdZW7VlU5xLakPRsG&cnr=14&ratebypass=yes&dur=396.062&lmt=1592770010992215&mt=1637322072&fvip=1&fexp=24001373%2C24007246&c=WEB&txp=2316222&n=0FUVcZrIZNKxLvnG&sparams=expire%2Cei%2Cip%2Cid%2Citag%2Csource%2Crequiressl%2Cvprv%2Cmime%2Cns%2Ccnr%2Cratebypass%2Cdur%2Clmt&sig=AOq0QJ8wRQIhAMg7HFMsZwwnYXsiVrBM-rPBB0Y5TNBUKEnAgHn_zHyoAiBmsMju7PWfgq9xArC0kzKjwcX0b5dy_JdEg3C82iu13g%3D%3D&lsparams=mh%2Cmm%2Cmn%2Cms%2Cmv%2Cmvi%2Cpl%2Cinitcwndbps&lsig=AG3C_xAwRAIgCX3noaFCQJi0iSZjvSQfnzTiaW_AgONj8dgAM4HEvVYCICUqZYJJawlen0VJsAVGoVsYvZW5rQ8QHgcY9BVFWdMx'
[download] Resuming download at byte 171484

ERROR: Did not get any data blocks
  File "./__main__.py", line 19, in <module>
    youtube_dl.main()
  File "/Users/briangenisio/khan/youtube-pipelines/export_and_convert/youtube-dl/youtube_dl/__init__.py", line 475, in main
    _real_main(argv)
  File "/Users/briangenisio/khan/youtube-pipelines/export_and_convert/youtube-dl/youtube_dl/__init__.py", line 465, in _real_main
    retcode = ydl.download(all_urls)
  File "/Users/briangenisio/khan/youtube-pipelines/export_and_convert/youtube-dl/youtube_dl/YoutubeDL.py", line 2069, in download
    url, force_generic_extractor=self.params.get('force_generic_extractor', False))
  File "/Users/briangenisio/khan/youtube-pipelines/export_and_convert/youtube-dl/youtube_dl/YoutubeDL.py", line 808, in extract_info
    return self.__extract_info(url, ie, download, extra_info, process)
  File "/Users/briangenisio/khan/youtube-pipelines/export_and_convert/youtube-dl/youtube_dl/YoutubeDL.py", line 815, in wrapper
    return func(self, *args, **kwargs)
  File "/Users/briangenisio/khan/youtube-pipelines/export_and_convert/youtube-dl/youtube_dl/YoutubeDL.py", line 847, in __extract_info
    return self.process_ie_result(ie_result, download, extra_info)
  File "/Users/briangenisio/khan/youtube-pipelines/export_and_convert/youtube-dl/youtube_dl/YoutubeDL.py", line 881, in process_ie_result
    return self.process_video_result(ie_result, download=download)
  File "/Users/briangenisio/khan/youtube-pipelines/export_and_convert/youtube-dl/youtube_dl/YoutubeDL.py", line 1692, in process_video_result
    self.process_info(new_info)
  File "/Users/briangenisio/khan/youtube-pipelines/export_and_convert/youtube-dl/youtube_dl/YoutubeDL.py", line 1976, in process_info
    success = dl(filename, info_dict)
  File "/Users/briangenisio/khan/youtube-pipelines/export_and_convert/youtube-dl/youtube_dl/YoutubeDL.py", line 1915, in dl
    return fd.download(name, info)
  File "/Users/briangenisio/khan/youtube-pipelines/export_and_convert/youtube-dl/youtube_dl/downloader/common.py", line 366, in download
    return self.real_download(filename, info_dict)
  File "/Users/briangenisio/khan/youtube-pipelines/export_and_convert/youtube-dl/youtube_dl/downloader/http.py", line 361, in real_download
    return download()
  File "/Users/briangenisio/khan/youtube-pipelines/export_and_convert/youtube-dl/youtube_dl/downloader/http.py", line 331, in download
    self.report_error('Did not get any data blocks')
  File "/Users/briangenisio/khan/youtube-pipelines/export_and_convert/youtube-dl/youtube_dl/downloader/common.py", line 165, in report_error
    self.ydl.report_error(*args, **kargs)
  File "/Users/briangenisio/khan/youtube-pipelines/export_and_convert/youtube-dl/youtube_dl/YoutubeDL.py", line 628, in report_error
    self.trouble(error_message, tb)
  File "/Users/briangenisio/khan/youtube-pipelines/export_and_convert/youtube-dl/youtube_dl/YoutubeDL.py", line 590, in trouble
    tb_data = traceback.format_list(traceback.extract_stack())
dirkf commented 2 years ago

That video just seems to be broken at the server end for format 22. Use 18 or 136+140 instead.

BrianGenisio commented 2 years ago

Oh, interesting. Thank you. 18 didn't work but 136+140 did. I'll need to learn a bit more because I have no idea what these numbers mean.

dirkf commented 2 years ago

The format IDs listed when you use the -F option:

$ youtube-dl -F -v Z2GD_BJoFPY
[debug] System config: ['--prefer-ffmpeg']
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-F', '-v', 'Z2GD_BJoFPY']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2021.06.06
[debug] Python version 3.5.2 (CPython) - Linux-4.4.0-210-generic-i686-with-Ubuntu-16.04-xenial
[debug] exe versions: avconv 4.3, avprobe 4.3, ffmpeg 4.3, ffprobe 4.3
[debug] Proxy map: {}
[youtube] Z2GD_BJoFPY: Downloading webpage
[youtube] Z2GD_BJoFPY: Downloading player ad2aeb77
[info] Available formats for Z2GD_BJoFPY:
format code  extension  resolution note
249          webm       audio only tiny   49k , webm_dash container, opus @ 49k (48000Hz), 2.32MiB
250          webm       audio only tiny   62k , webm_dash container, opus @ 62k (48000Hz), 2.95MiB
251          webm       audio only tiny  108k , webm_dash container, opus @108k (48000Hz), 5.13MiB
140          m4a        audio only tiny  129k , m4a_dash container, mp4a.40.2@129k (44100Hz), 6.11MiB
160          mp4        256x144    144p   14k , mp4_dash container, avc1.4d400c@  14k, 25fps, video only, 706.08KiB
278          webm       256x144    144p   17k , webm_dash container, vp9@  17k, 25fps, video only, 860.61KiB
242          webm       426x240    240p   21k , webm_dash container, vp9@  21k, 25fps, video only, 1.02MiB
133          mp4        426x240    240p   23k , mp4_dash container, avc1.4d4015@  23k, 25fps, video only, 1.09MiB
243          webm       640x360    360p   32k , webm_dash container, vp9@  32k, 25fps, video only, 1.51MiB
134          mp4        640x360    360p   33k , mp4_dash container, avc1.4d401e@  33k, 25fps, video only, 1.57MiB
244          webm       854x480    480p   42k , webm_dash container, vp9@  42k, 25fps, video only, 2.00MiB
135          mp4        854x480    480p   48k , mp4_dash container, avc1.4d401e@  48k, 25fps, video only, 2.27MiB
247          webm       1280x720   720p   67k , webm_dash container, vp9@  67k, 25fps, video only, 3.19MiB
136          mp4        1280x720   720p   71k , mp4_dash container, avc1.64001f@  71k, 25fps, video only, 3.37MiB
18           mp4        640x360    360p  109k , avc1.42001E, 25fps, mp4a.40.2 (44100Hz), 5.18MiB
22           mp4        1280x720   720p  200k , avc1.64001F, 25fps, mp4a.40.2 (44100Hz) (best)
$