ytdl-org / youtube-dl

Command-line program to download videos from YouTube.com and other video sites
http://ytdl-org.github.io/youtube-dl/
The Unlicense
131.47k stars 9.96k forks source link

learner.org Error 403: #25022

Open rwarford opened 4 years ago

rwarford commented 4 years ago

Checklist

Verbose log

[debug] System config: [] [debug] User config: [] [debug] Custom config: [] [debug] Command-line args: ['--verbose', '-f', 'bestvideo+bestaudio/best', '--cookies', './cookies.txt', 'https://www.learner.org/series/french-in-action/transportation-and-travel-ii/'] [debug] Encodings: locale cp1252, fs mbcs, out cp1252, pref cp1252 [debug] youtube-dl version 2020.03.24 [debug] Python version 3.4.4 (CPython) - Windows-7-6.1.7601-SP1 [debug] exe versions: ffmpeg N-50911-g9efcfbe [debug] Proxy map: {} [generic] transportation-and-travel-ii: Requesting header WARNING: Falling back on generic information extractor. [generic] transportation-and-travel-ii: Downloading webpage [generic] transportation-and-travel-ii: Extracting information [download] Downloading playlist: Transportation and Travel II - Annenberg Learner [generic] playlist Transportation and Travel II - Annenberg Learner: Collected 1 video ids (downloading 1 of them) [download] Downloading video 1 of 1 [JWPlatform] 2rbFjnOK: Downloading JSON metadata ERROR: Unable to download JSON metadata: HTTP Error 403: Forbidden (caused by HTTPError()); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type youtube-dl -U to update. Be sure to call youtube-dl with the --verbose flag and include its complete output. File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpjwbwqymm\build\youtube_dl\extractor\common.py", line 627, in _request_webpage File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpjwbwqymm\build\youtube_dl\YoutubeDL.py", line 2238, in urlopen File "C:\Python\Python34\lib\urllib\request.py", line 470, in open File "C:\Python\Python34\lib\urllib\request.py", line 580, in http_response File "C:\Python\Python34\lib\urllib\request.py", line 508, in error File "C:\Python\Python34\lib\urllib\request.py", line 442, in _call_chain File "C:\Python\Python34\lib\urllib\request.py", line 588, in http_error_default

Description

This worked as of August 2019. I've downloaded cookies. I've tried clearing the cache with --rm-cache-dir.

rwarford commented 4 years ago

For what it's worth, here's a log when I used --rm-cache-dir:

[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['--verbose', '--cookies', './cookies.txt', '--prefer-insecure', '--retries', '30', '--rm-cache-dir', '--referer', 'https://content.jwplatform.com', 'https://www.learner.org/series/french-in-action/transportation-and-travel-ii/', '-o', 'fia28.mp4']
[debug] Encodings: locale cp1252, fs mbcs, out cp1252, pref cp1252
[debug] youtube-dl version 2020.03.24
[debug] Python version 3.4.4 (CPython) - Windows-7-6.1.7601-SP1
[debug] exe versions: ffmpeg N-50911-g9efcfbe
[debug] Proxy map: {}
Removing cache dir C:\Users\Roger/.cache\youtube-dl ..
[generic] transportation-and-travel-ii: Requesting header
WARNING: Falling back on generic information extractor.
[generic] transportation-and-travel-ii: Downloading webpage
[generic] transportation-and-travel-ii: Extracting information
[download] Downloading playlist: Transportation and Travel II - Annenberg Learner
[generic] playlist Transportation and Travel II - Annenberg Learner: Collected 1 video ids (downloading 1 of them)
[download] Downloading video 1 of 1
[JWPlatform] 2rbFjnOK: Downloading JSON metadata
ERROR: Unable to download JSON metadata: HTTP Error 403: Forbidden (caused by HTTPError()); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpjwbwqymm\build\youtube_dl\extractor\common.py", line 627, in _request_webpage
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpjwbwqymm\build\youtube_dl\YoutubeDL.py", line 2238, in urlopen
  File "C:\Python\Python34\lib\urllib\request.py", line 470, in open
  File "C:\Python\Python34\lib\urllib\request.py", line 580, in http_response
  File "C:\Python\Python34\lib\urllib\request.py", line 508, in error
  File "C:\Python\Python34\lib\urllib\request.py", line 442, in _call_chain
  File "C:\Python\Python34\lib\urllib\request.py", line 588, in http_error_default

If I use Chrome developer tools and use the url in playlist[0].sources[0].file I am able to make more progess but it always fails with An unexpected TLS handshake packet was received.. This log is from the best run I've had so far, it captured all but the last couple of minutes of video, but no audio:

[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['--verbose', '--cookies', './cookies.txt', '--prefer-insecure', '--retries', '30', '--rm-cache-dir', '--referer', 'https://content.jwplatform.com', 'https://learner-uswe.streaming.media.azure.net/edb7884b-ced4-4670-9f38-3cb2ea4f76ef/french_in_action_28-1250.ism/manifest(format=m3u8-aapl)', '-o', 'fia28.mp4']
[debug] Encodings: locale cp1252, fs mbcs, out cp1252, pref cp1252
[debug] youtube-dl version 2020.03.24
[debug] Python version 3.4.4 (CPython) - Windows-7-6.1.7601-SP1
[debug] exe versions: ffmpeg N-50911-g9efcfbe
[debug] Proxy map: {}
Removing cache dir C:\Users\Roger/.cache\youtube-dl ..
[generic] manifest(format=m3u8-aapl): Requesting header
[generic] manifest(format=m3u8-aapl): Downloading m3u8 information
[debug] Default format spec: bestvideo+bestaudio/best
[debug] Invoking downloader on 'https://learner-uswe.streaming.media.azure.net/edb7884b-ced4-4670-9f38-3cb2ea4f76ef/french_in_action_28-1250.ism/QualityLevels(3380865)/Manifest(video,format=m3u8-aapl)'
[download] Destination: fia28.f3602.mp4
[debug] ffmpeg command line: ffmpeg -y -loglevel verbose -headers "Accept-Encoding: gzip, deflate
Accept-Language: en-us,en;q=0.5
Referer: https://content.jwplatform.com
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3540.0 Safari/537.36
" -i "https://learner-uswe.streaming.media.azure.net/edb7884b-ced4-4670-9f38-3cb2ea4f76ef/french_in_action_28-1250.ism/QualityLevels(3380865)/Manifest(video,format=m3u8-aapl)" -c copy -f mp4 "file:fia28.f3602.mp4.part"
ffmpeg version N-50911-g9efcfbe Copyright (c) 2000-2013 the FFmpeg developers
  built on Mar 13 2013 21:26:48 with gcc 4.7.2 (GCC)
  configuration: --enable-gpl --enable-version3 --disable-w32threads --enable-avisynth --enable-bzlib --enable-fontconfig --enable-frei0r --enable-gnutls --enable-libass --enable-libbluray --enable-libcaca --enable-libfreetype --enable-libgsm --enable-libilbc --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-libopus --enable-librtmp --enable-libschroedinger --enable-libsoxr --enable-libspeex --enable-libtheora --enable-libtwolame --enable-libvo-aacenc --enable-libvo-amrwbenc --enable-libvorbis --enable-libvpx --enable-libx264 --enable-libxavs --enable-libxvid --enable-zlib
  libavutil      52. 19.100 / 52. 19.100
  libavcodec     55.  0.100 / 55.  0.100
  libavformat    55.  0.100 / 55.  0.100
  libavdevice    54.  4.100 / 54.  4.100
  libavfilter     3. 45.103 /  3. 45.103
  libswscale      2.  2.100 /  2.  2.100
  libswresample   0. 17.102 /  0. 17.102
  libpostproc    52.  2.100 / 52.  2.100
[mpegts @ 02140820] Estimating duration from bitrate, this may be inaccurate
Input #0, hls,applehttp, from 'https://learner-uswe.streaming.media.azure.net/edb7884b-ced4-4670-9f38-3cb2ea4f76ef/french_in_action_28-1250.ism/QualityLevels(3380865)/Manifest(video,format=m3u8-aapl)':
  Duration: 00:28:36.00, start: 0.066722, bitrate: 0 kb/s
  Program 0 
    Metadata:
      variant_bitrate : 0
    Stream #0:0: Video: h264 (High) ([27][0][0][0] / 0x001B), yuv420p, 960x720 [SAR 1:1 DAR 4:3], 14.99 fps, 29.97 tbr, 90k tbn, 59.94 tbc
Output #0, mp4, to 'file:fia28.f3602.mp4.part':
  Metadata:
    encoder         : Lavf55.0.100
    Stream #0:0: Video: h264 ([33][0][0][0] / 0x0021), yuv420p, 960x720 [SAR 1:1 DAR 4:3], q=2-31, 14.99 fps, 90k tbn, 90k tbc
Stream mapping:
  Stream #0:0 -> #0:0 (copy)
Press [q] to stop, [?] for help
frame=  360 fps=0.0 q=-1.0 size=    4974kB time=00:00:11.91 bitrate=3420.5kbits/s    
frame=  659 fps=618 q=-1.0 size=    9907kB time=00:00:21.88 bitrate=3708.0kbits/s    
frame=  901 fps=575 q=-1.0 size=   13245kB time=00:00:29.96 bitrate=3621.1kbits/s    
frame= 1260 fps=581 q=-1.0 size=   18228kB time=00:00:41.94 bitrate=3560.2kbits/s    
frame= 1620 fps=580 q=-1.0 size=   22363kB time=00:00:53.95 bitrate=3395.5kbits/s    
frame= 1940 fps=589 q=-1.0 size=   27611kB time=00:01:04.63 bitrate=3499.7kbits/s    
frame= 2160 fps=567 q=-1.0 size=   30662kB time=00:01:11.97 bitrate=3490.1kbits/s    
frame= 2512 fps=583 q=-1.0 size=   35594kB time=00:01:23.71 bitrate=3483.0kbits/s    
frame= 2718 fps=565 q=-1.0 size=   38236kB time=00:01:30.59 bitrate=3457.6kbits/s    
frame= 3060 fps=571 q=-1.0 size=   42551kB time=00:01:42.00 bitrate=3417.3kbits/s    
frame= 3416 fps=583 q=-1.0 size=   47840kB time=00:01:53.88 bitrate=3441.4kbits/s    
frame= 3610 fps=568 q=-1.0 size=   50854kB time=00:02:00.35 bitrate=3461.4kbits/s    
frame= 3960 fps=573 q=-1.0 size=   55360kB time=00:02:12.03 bitrate=3434.8kbits/s    
frame= 4320 fps=577 q=-1.0 size=   59871kB time=00:02:24.04 bitrate=3405.0kbits/s    
frame= 4674 fps=585 q=-1.0 size=   64933kB time=00:02:35.85 bitrate=3413.0kbits/s    
frame= 4926 fps=580 q=-1.0 size=   68279kB time=00:02:44.26 bitrate=3405.1kbits/s    
frame= 5220 fps=577 q=-1.0 size=   72697kB time=00:02:54.07 bitrate=3421.2kbits/s    
frame= 5580 fps=578 q=-1.0 size=   77679kB time=00:03:06.08 bitrate=3419.7kbits/s    
frame= 5940 fps=580 q=-1.0 size=   82471kB time=00:03:18.09 bitrate=3410.5kbits/s    
frame= 6284 fps=585 q=-1.0 size=   87130kB time=00:03:29.57 bitrate=3405.8kbits/s    
frame= 6501 fps=578 q=-1.0 size=   90858kB time=00:03:36.81 bitrate=3432.9kbits/s    
frame= 6840 fps=580 q=-1.0 size=   95274kB time=00:03:48.12 bitrate=3421.3kbits/s    
frame= 7198 fps=585 q=-1.0 size=  100473kB time=00:04:00.07 bitrate=3428.4kbits/s    
frame= 7443 fps=582 q=-1.0 size=  103782kB time=00:04:08.24 bitrate=3424.7kbits/s    
frame= 7740 fps=582 q=-1.0 size=  107708kB time=00:04:18.15 bitrate=3417.8kbits/s    
frame= 8100 fps=584 q=-1.0 size=  112285kB time=00:04:30.16 bitrate=3404.7kbits/s    
frame= 8430 fps=586 q=-1.0 size=  117363kB time=00:04:41.18 bitrate=3419.3kbits/s    
frame= 8694 fps=585 q=-1.0 size=  120527kB time=00:04:49.98 bitrate=3404.8kbits/s    
frame= 9000 fps=584 q=-1.0 size=  124721kB time=00:05:00.19 bitrate=3403.4kbits/s    
frame= 9360 fps=585 q=-1.0 size=  129630kB time=00:05:12.21 bitrate=3401.3kbits/s    
frame= 9720 fps=586 q=-1.0 size=  134618kB time=00:05:24.22 bitrate=3401.3kbits/s    
frame=10010 fps=586 q=-1.0 size=  138889kB time=00:05:33.90 bitrate=3407.5kbits/s    
frame=10260 fps=582 q=-1.0 size=  142801kB time=00:05:42.24 bitrate=3418.1kbits/s    
frame=10620 fps=583 q=-1.0 size=  147572kB time=00:05:54.25 bitrate=3412.5kbits/s    
frame=10980 fps=584 q=-1.0 size=  152432kB time=00:06:06.26 bitrate=3409.3kbits/s    
frame=11174 fps=578 q=-1.0 size=  154925kB time=00:06:12.73 bitrate=3404.9kbits/s    
frame=11221 fps=566 q=-1.0 size=  155561kB time=00:06:14.30 bitrate=3404.6kbits/s    
frame=11254 fps=553 q=-1.0 size=  156039kB time=00:06:15.40 bitrate=3405.0kbits/s    
frame=11281 fps=541 q=-1.0 size=  156452kB time=00:06:16.30 bitrate=3405.9kbits/s    
frame=11318 fps=529 q=-1.0 size=  156999kB time=00:06:17.54 bitrate=3406.6kbits/s    
The TLS connection was non-properly terminated.
[tls @ 0210f2a0] The specified session has been invalidated for some reason.
frame=11340 fps=516 q=-1.0 size=  157277kB time=00:06:18.27 bitrate=3406.0kbits/s    
frame=11678 fps=519 q=-1.0 size=  161964kB time=00:06:29.55 bitrate=3405.9kbits/s    
frame=11882 fps=516 q=-1.0 size=  165435kB time=00:06:36.36 bitrate=3419.2kbits/s    
frame=12240 fps=520 q=-1.0 size=  169833kB time=00:06:48.30 bitrate=3407.4kbits/s    
frame=12600 fps=522 q=-1.0 size=  174508kB time=00:07:00.31 bitrate=3401.1kbits/s    
frame=12960 fps=523 q=-1.0 size=  179660kB time=00:07:12.33 bitrate=3404.3kbits/s    
frame=13320 fps=525 q=-1.0 size=  184536kB time=00:07:24.34 bitrate=3402.1kbits/s    
frame=13680 fps=526 q=-1.0 size=  189581kB time=00:07:36.35 bitrate=3403.2kbits/s    
frame=14040 fps=528 q=-1.0 size=  194544kB time=00:07:48.36 bitrate=3402.7kbits/s    
frame=14354 fps=530 q=-1.0 size=  199673kB time=00:07:58.84 bitrate=3416.0kbits/s    
frame=14583 fps=528 q=-1.0 size=  202862kB time=00:08:06.48 bitrate=3416.0kbits/s    
frame=14940 fps=530 q=-1.0 size=  207623kB time=00:08:18.39 bitrate=3412.6kbits/s    
frame=15300 fps=532 q=-1.0 size=  212596kB time=00:08:30.40 bitrate=3412.1kbits/s    
frame=15502 fps=529 q=-1.0 size=  215556kB time=00:08:37.14 bitrate=3414.6kbits/s    
frame=15558 fps=522 q=-1.0 size=  216201kB time=00:08:39.01 bitrate=3412.4kbits/s    
frame=15614 fps=513 q=-1.0 size=  216839kB time=00:08:40.88 bitrate=3410.2kbits/s    
frame=15649 fps=503 q=-1.0 size=  217436kB time=00:08:42.05 bitrate=3412.0kbits/s    
frame=15840 fps=500 q=-1.0 size=  220000kB time=00:08:48.42 bitrate=3410.6kbits/s    
frame=16179 fps=502 q=-1.0 size=  224966kB time=00:08:59.73 bitrate=3414.5kbits/s    
frame=16396 fps=501 q=-1.0 size=  227955kB time=00:09:06.97 bitrate=3414.0kbits/s    
frame=16740 fps=503 q=-1.0 size=  232570kB time=00:09:18.45 bitrate=3411.6kbits/s    
frame=17036 fps=504 q=-1.0 size=  236830kB time=00:09:28.33 bitrate=3413.7kbits/s    
frame=17280 fps=504 q=-1.0 size=  240054kB time=00:09:36.47 bitrate=3411.3kbits/s    
frame=17640 fps=506 q=-1.0 size=  244418kB time=00:09:48.48 bitrate=3402.4kbits/s    
frame=18000 fps=508 q=-1.0 size=  249366kB time=00:10:00.49 bitrate=3401.8kbits/s    
frame=18310 fps=509 q=-1.0 size=  254451kB time=00:10:10.84 bitrate=3412.4kbits/s    
frame=18360 fps=493 q=-1.0 size=  255040kB time=00:10:12.51 bitrate=3411.0kbits/s    
frame=18540 fps=487 q=-1.0 size=  257330kB time=00:10:18.51 bitrate=3408.2kbits/s    
frame=18720 fps=483 q=-1.0 size=  259575kB time=00:10:24.52 bitrate=3404.9kbits/s    
frame=18900 fps=477 q=-1.0 size=  262391kB time=00:10:30.52 bitrate=3409.1kbits/s    
frame=19080 fps=470 q=-1.0 size=  265036kB time=00:10:36.53 bitrate=3410.9kbits/s    
frame=19260 fps=468 q=-1.0 size=  267213kB time=00:10:42.54 bitrate=3406.8kbits/s    
frame=19440 fps=465 q=-1.0 size=  269563kB time=00:10:48.54 bitrate=3404.9kbits/s    
frame=19620 fps=462 q=-1.0 size=  272258kB time=00:10:54.55 bitrate=3407.4kbits/s    
frame=19800 fps=458 q=-1.0 size=  274597kB time=00:11:00.55 bitrate=3405.4kbits/s    
frame=19980 fps=455 q=-1.0 size=  276857kB time=00:11:06.56 bitrate=3402.5kbits/s    
frame=20160 fps=452 q=-1.0 size=  279332kB time=00:11:12.57 bitrate=3402.3kbits/s    
frame=20340 fps=450 q=-1.0 size=  281949kB time=00:11:18.57 bitrate=3403.8kbits/s    
frame=20520 fps=448 q=-1.0 size=  284475kB time=00:11:24.58 bitrate=3404.1kbits/s    
frame=20700 fps=444 q=-1.0 size=  286737kB time=00:11:30.58 bitrate=3401.4kbits/s    
frame=20880 fps=440 q=-1.0 size=  289242kB time=00:11:36.59 bitrate=3401.5kbits/s    
frame=21060 fps=438 q=-1.0 size=  291769kB time=00:11:42.60 bitrate=3401.9kbits/s    
frame=21240 fps=434 q=-1.0 size=  294296kB time=00:11:48.60 bitrate=3402.3kbits/s    
frame=21420 fps=431 q=-1.0 size=  296745kB time=00:11:54.61 bitrate=3401.7kbits/s    
frame=21600 fps=429 q=-1.0 size=  299679kB time=00:12:00.61 bitrate=3406.8kbits/s    
frame=21780 fps=426 q=-1.0 size=  302489kB time=00:12:06.62 bitrate=3410.3kbits/s    
frame=21960 fps=424 q=-1.0 size=  304931kB time=00:12:12.63 bitrate=3409.6kbits/s    
frame=22140 fps=423 q=-1.0 size=  306946kB time=00:12:18.63 bitrate=3404.2kbits/s    
frame=22320 fps=420 q=-1.0 size=  309572kB time=00:12:24.64 bitrate=3405.7kbits/s    
frame=22500 fps=419 q=-1.0 size=  311850kB time=00:12:30.64 bitrate=3403.3kbits/s    
frame=22680 fps=417 q=-1.0 size=  314517kB time=00:12:36.65 bitrate=3405.1kbits/s    
frame=22860 fps=415 q=-1.0 size=  316788kB time=00:12:42.66 bitrate=3402.7kbits/s    
frame=23040 fps=413 q=-1.0 size=  319466kB time=00:12:48.66 bitrate=3404.7kbits/s    
frame=23220 fps=411 q=-1.0 size=  321698kB time=00:12:54.67 bitrate=3401.9kbits/s    
frame=23400 fps=408 q=-1.0 size=  324257kB time=00:13:00.67 bitrate=3402.6kbits/s    
frame=23580 fps=405 q=-1.0 size=  327077kB time=00:13:06.68 bitrate=3406.0kbits/s    
frame=23760 fps=401 q=-1.0 size=  329539kB time=00:13:12.69 bitrate=3405.6kbits/s    
frame=23940 fps=399 q=-1.0 size=  332024kB time=00:13:18.69 bitrate=3405.5kbits/s    
frame=24120 fps=398 q=-1.0 size=  334372kB time=00:13:24.70 bitrate=3404.0kbits/s    
frame=24300 fps=396 q=-1.0 size=  336789kB time=00:13:30.70 bitrate=3403.2kbits/s    
frame=24480 fps=393 q=-1.0 size=  339310kB time=00:13:36.71 bitrate=3403.4kbits/s    
frame=24660 fps=390 q=-1.0 size=  341765kB time=00:13:42.72 bitrate=3403.0kbits/s    
frame=24840 fps=387 q=-1.0 size=  344498kB time=00:13:48.72 bitrate=3405.4kbits/s    
frame=25020 fps=386 q=-1.0 size=  347227kB time=00:13:54.73 bitrate=3407.7kbits/s    
frame=25200 fps=384 q=-1.0 size=  349933kB time=00:14:00.73 bitrate=3409.7kbits/s    
frame=25380 fps=381 q=-1.0 size=  352064kB time=00:14:06.74 bitrate=3406.1kbits/s    
frame=25515 fps=381 q=-1.0 size=  353713kB time=00:14:11.25 bitrate=3404.0kbits/s    
frame=25560 fps=378 q=-1.0 size=  354212kB time=00:14:12.75 bitrate=3402.8kbits/s    
frame=25736 fps=378 q=-1.0 size=  356388kB time=00:14:18.62 bitrate=3400.2kbits/s    
frame=25741 fps=375 q=-1.0 size=  356513kB time=00:14:18.79 bitrate=3400.8kbits/s    
frame=25920 fps=372 q=-1.0 size=  359031kB time=00:14:24.76 bitrate=3401.1kbits/s    
frame=26100 fps=370 q=-1.0 size=  361653kB time=00:14:30.76 bitrate=3402.3kbits/s    
frame=26280 fps=369 q=-1.0 size=  364733kB time=00:14:36.77 bitrate=3407.8kbits/s    
frame=26460 fps=367 q=-1.0 size=  367305kB time=00:14:42.78 bitrate=3408.5kbits/s    
frame=26640 fps=366 q=-1.0 size=  369814kB time=00:14:48.78 bitrate=3408.6kbits/s    
frame=26820 fps=364 q=-1.0 size=  372216kB time=00:14:54.79 bitrate=3407.7kbits/s    
frame=27000 fps=363 q=-1.0 size=  374766kB time=00:15:00.79 bitrate=3408.2kbits/s    
frame=27180 fps=362 q=-1.0 size=  376965kB time=00:15:06.80 bitrate=3405.5kbits/s    
frame=27360 fps=360 q=-1.0 size=  379236kB time=00:15:12.81 bitrate=3403.4kbits/s    
frame=27540 fps=359 q=-1.0 size=  381815kB time=00:15:18.81 bitrate=3404.2kbits/s    
frame=27720 fps=358 q=-1.0 size=  384109kB time=00:15:24.82 bitrate=3402.4kbits/s    
frame=27900 fps=357 q=-1.0 size=  386470kB time=00:15:30.82 bitrate=3401.2kbits/s    
frame=28066 fps=357 q=-1.0 size=  389126kB time=00:15:36.36 bitrate=3404.3kbits/s    
frame=28089 fps=355 q=-1.0 size=  389531kB time=00:15:37.13 bitrate=3405.1kbits/s    
frame=28260 fps=353 q=-1.0 size=  391547kB time=00:15:42.84 bitrate=3402.0kbits/s    
frame=28440 fps=352 q=-1.0 size=  393991kB time=00:15:48.84 bitrate=3401.6kbits/s    
frame=28620 fps=350 q=-1.0 size=  396299kB time=00:15:54.85 bitrate=3400.0kbits/s    
frame=28800 fps=349 q=-1.0 size=  399107kB time=00:16:00.85 bitrate=3402.7kbits/s    
frame=28980 fps=347 q=-1.0 size=  402084kB time=00:16:06.86 bitrate=3406.8kbits/s    
frame=29160 fps=346 q=-1.0 size=  404686kB time=00:16:12.87 bitrate=3407.6kbits/s    
frame=29340 fps=346 q=-1.0 size=  407202kB time=00:16:18.87 bitrate=3407.8kbits/s    
frame=29520 fps=344 q=-1.0 size=  409638kB time=00:16:24.88 bitrate=3407.3kbits/s    
frame=29700 fps=342 q=-1.0 size=  411778kB time=00:16:30.88 bitrate=3404.3kbits/s    
frame=29845 fps=342 q=-1.0 size=  413581kB time=00:16:35.72 bitrate=3402.6kbits/s    
frame=29880 fps=340 q=-1.0 size=  413968kB time=00:16:36.89 bitrate=3401.8kbits/s    
frame=30042 fps=340 q=-1.0 size=  416341kB time=00:16:42.30 bitrate=3402.8kbits/s    
frame=30060 fps=337 q=-1.0 size=  416560kB time=00:16:42.90 bitrate=3402.6kbits/s    
frame=30121 fps=336 q=-1.0 size=  417462kB time=00:16:44.93 bitrate=3403.0kbits/s    
frame=30181 fps=334 q=-1.0 size=  418360kB time=00:16:46.93 bitrate=3403.6kbits/s    
frame=30240 fps=331 q=-1.0 size=  419246kB time=00:16:48.90 bitrate=3404.1kbits/s    
frame=30344 fps=331 q=-1.0 size=  420694kB time=00:16:52.37 bitrate=3404.2kbits/s    
frame=30420 fps=328 q=-1.0 size=  421569kB time=00:16:54.91 bitrate=3402.7kbits/s    
frame=30585 fps=328 q=-1.0 size=  423740kB time=00:17:00.41 bitrate=3401.8kbits/s    
frame=30600 fps=326 q=-1.0 size=  423887kB time=00:17:00.91 bitrate=3401.3kbits/s    
frame=30766 fps=326 q=-1.0 size=  426707kB time=00:17:06.45 bitrate=3405.5kbits/s    
frame=30781 fps=325 q=-1.0 size=  426909kB time=00:17:06.95 bitrate=3405.4kbits/s    
frame=30960 fps=324 q=-1.0 size=  429606kB time=00:17:12.93 bitrate=3407.1kbits/s    
frame=31140 fps=323 q=-1.0 size=  432136kB time=00:17:18.93 bitrate=3407.4kbits/s    
frame=31320 fps=323 q=-1.0 size=  434398kB time=00:17:24.94 bitrate=3405.5kbits/s    
frame=31500 fps=321 q=-1.0 size=  437063kB time=00:17:30.94 bitrate=3406.8kbits/s    
frame=31680 fps=320 q=-1.0 size=  439488kB time=00:17:36.95 bitrate=3406.3kbits/s    
frame=31860 fps=319 q=-1.0 size=  441507kB time=00:17:42.96 bitrate=3402.6kbits/s    
frame=32040 fps=318 q=-1.0 size=  443941kB time=00:17:48.96 bitrate=3402.1kbits/s    
frame=32220 fps=317 q=-1.0 size=  446642kB time=00:17:54.97 bitrate=3403.7kbits/s    
frame=32400 fps=316 q=-1.0 size=  449237kB time=00:18:00.97 bitrate=3404.5kbits/s    
frame=32580 fps=315 q=-1.0 size=  451888kB time=00:18:06.98 bitrate=3405.6kbits/s    
frame=32760 fps=313 q=-1.0 size=  453894kB time=00:18:12.99 bitrate=3401.9kbits/s    
frame=32861 fps=313 q=-1.0 size=  455519kB time=00:18:16.36 bitrate=3403.6kbits/s    
frame=32940 fps=311 q=-1.0 size=  456578kB time=00:18:18.99 bitrate=3403.4kbits/s    
frame=33094 fps=311 q=-1.0 size=  458980kB time=00:18:24.13 bitrate=3405.3kbits/s    
frame=33121 fps=310 q=-1.0 size=  459327kB time=00:18:25.03 bitrate=3405.1kbits/s    
frame=33243 fps=309 q=-1.0 size=  460892kB time=00:18:29.10 bitrate=3404.2kbits/s    
frame=33300 fps=308 q=-1.0 size=  461567kB time=00:18:31.00 bitrate=3403.3kbits/s    
frame=33389 fps=307 q=-1.0 size=  463067kB time=00:18:33.97 bitrate=3405.3kbits/s    
frame=33480 fps=305 q=-1.0 size=  464296kB time=00:18:37.01 bitrate=3405.1kbits/s    
frame=33598 fps=305 q=-1.0 size=  466154kB time=00:18:40.95 bitrate=3406.7kbits/s    
frame=33660 fps=303 q=-1.0 size=  466970kB time=00:18:43.02 bitrate=3406.4kbits/s    
frame=33840 fps=302 q=-1.0 size=  469439kB time=00:18:49.02 bitrate=3406.2kbits/s    
frame=34020 fps=301 q=-1.0 size=  472026kB time=00:18:55.03 bitrate=3406.8kbits/s    
frame=34200 fps=300 q=-1.0 size=  474389kB time=00:19:01.03 bitrate=3405.8kbits/s    
frame=34380 fps=300 q=-1.0 size=  476719kB time=00:19:07.04 bitrate=3404.6kbits/s    
frame=34560 fps=299 q=-1.0 size=  479055kB time=00:19:13.05 bitrate=3403.5kbits/s    
frame=34740 fps=297 q=-1.0 size=  481777kB time=00:19:19.05 bitrate=3405.1kbits/s    
frame=34920 fps=296 q=-1.0 size=  484562kB time=00:19:25.06 bitrate=3407.1kbits/s    
frame=35100 fps=295 q=-1.0 size=  486891kB time=00:19:31.06 bitrate=3406.0kbits/s    
frame=35280 fps=294 q=-1.0 size=  488802kB time=00:19:37.07 bitrate=3401.9kbits/s    
frame=35460 fps=293 q=-1.0 size=  491182kB time=00:19:43.08 bitrate=3401.1kbits/s    
frame=35640 fps=292 q=-1.0 size=  493695kB time=00:19:49.08 bitrate=3401.2kbits/s    
frame=35820 fps=291 q=-1.0 size=  496276kB time=00:19:55.09 bitrate=3401.8kbits/s    
frame=36000 fps=291 q=-1.0 size=  498677kB time=00:20:01.09 bitrate=3401.2kbits/s    
frame=36180 fps=291 q=-1.0 size=  501724kB time=00:20:07.10 bitrate=3404.9kbits/s    
frame=36360 fps=291 q=-1.0 size=  504167kB time=00:20:13.11 bitrate=3404.6kbits/s    
frame=36540 fps=291 q=-1.0 size=  506733kB time=00:20:19.11 bitrate=3405.1kbits/s    
frame=36720 fps=291 q=-1.0 size=  509381kB time=00:20:25.12 bitrate=3406.1kbits/s    
An unexpected TLS handshake packet was received.
[crypto @ 04bf8de0] Unable to open input
https://learner-uswe.streaming.media.azure.net/edb7884b-ced4-4670-9f38-3cb2ea4f76ef/french_in_action_28-1250.ism/QualityLevels(3380865)/Manifest(video,format=m3u8-aapl): Input/output error
No more output streams to write to, finishing.
frame=36900 fps=291 q=-1.0 Lsize=  512247kB time=00:20:31.12 bitrate=3408.5kbits/s    

video:511812kB audio:0kB subtitle:0 global headers:0kB muxing overhead 0.084925%

[ffmpeg] Downloaded 524540519 bytes

[download] 100% of 500.24MiB in 02:07
[debug] Invoking downloader on 'https://learner-uswe.streaming.media.azure.net/edb7884b-ced4-4670-9f38-3cb2ea4f76ef/french_in_action_28-1250.ism/QualityLevels(127999)/Manifest(aac_UND_2_127,format=m3u8-aapl)'
[download] Destination: fia28.f138.mp4
[debug] ffmpeg command line: ffmpeg -y -loglevel verbose -headers "Accept-Encoding: gzip, deflate
Accept-Language: en-us,en;q=0.5
Referer: https://content.jwplatform.com
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3540.0 Safari/537.36
" -i "https://learner-uswe.streaming.media.azure.net/edb7884b-ced4-4670-9f38-3cb2ea4f76ef/french_in_action_28-1250.ism/QualityLevels(127999)/Manifest(aac_UND_2_127,format=m3u8-aapl)" -c copy -f mp4 "-bsf:a" aac_adtstoasc "file:fia28.f138.mp4.part"
ffmpeg version N-50911-g9efcfbe Copyright (c) 2000-2013 the FFmpeg developers
  built on Mar 13 2013 21:26:48 with gcc 4.7.2 (GCC)
  configuration: --enable-gpl --enable-version3 --disable-w32threads --enable-avisynth --enable-bzlib --enable-fontconfig --enable-frei0r --enable-gnutls --enable-libass --enable-libbluray --enable-libcaca --enable-libfreetype --enable-libgsm --enable-libilbc --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-libopus --enable-librtmp --enable-libschroedinger --enable-libsoxr --enable-libspeex --enable-libtheora --enable-libtwolame --enable-libvo-aacenc --enable-libvo-amrwbenc --enable-libvorbis --enable-libvpx --enable-libx264 --enable-libxavs --enable-libxvid --enable-zlib
  libavutil      52. 19.100 / 52. 19.100
  libavcodec     55.  0.100 / 55.  0.100
  libavformat    55.  0.100 / 55.  0.100
  libavdevice    54.  4.100 / 54.  4.100
  libavfilter     3. 45.103 /  3. 45.103
  libswscale      2.  2.100 /  2.  2.100
  libswresample   0. 17.102 /  0. 17.102
  libpostproc    52.  2.100 / 52.  2.100
[tls @ 01fa02c0] An unexpected TLS handshake packet was received.
[crypto @ 01f9ee80] Unable to open input
[hls,applehttp @ 0210ccc0] Error when loading first segment 'https://learner-uswe.streaming.media.azure.net/edb7884b-ced4-4670-9f38-3cb2ea4f76ef/french_in_action_28-1250.ism/QualityLevels(127999)/Fragments(aac_UND_2_127=0,format=m3u8-aapl)'
https://learner-uswe.streaming.media.azure.net/edb7884b-ced4-4670-9f38-3cb2ea4f76ef/french_in_action_28-1250.ism/QualityLevels(127999)/Manifest(aac_UND_2_127,format=m3u8-aapl): Input/output error

ERROR: ffmpeg exited with code 1
  File "__main__.py", line 19, in <module>
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpjwbwqymm\build\youtube_dl\__init__.py", line 474, in main
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpjwbwqymm\build\youtube_dl\__init__.py", line 464, in _real_main
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpjwbwqymm\build\youtube_dl\YoutubeDL.py", line 2019, in download
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpjwbwqymm\build\youtube_dl\YoutubeDL.py", line 808, in extract_info
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpjwbwqymm\build\youtube_dl\YoutubeDL.py", line 863, in process_ie_result
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpjwbwqymm\build\youtube_dl\YoutubeDL.py", line 1644, in process_video_result
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpjwbwqymm\build\youtube_dl\YoutubeDL.py", line 1920, in process_info
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpjwbwqymm\build\youtube_dl\YoutubeDL.py", line 1865, in dl
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpjwbwqymm\build\youtube_dl\downloader\common.py", line 366, in download
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpjwbwqymm\build\youtube_dl\downloader\external.py", line 64, in real_download
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpjwbwqymm\build\youtube_dl\downloader\common.py", line 165, in report_error
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpjwbwqymm\build\youtube_dl\YoutubeDL.py", line 625, in report_error
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpjwbwqymm\build\youtube_dl\YoutubeDL.py", line 587, in trouble
rwarford commented 4 years ago

Perhaps the error message from Ubuntu is more helpful:

[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'--verbose', u'--cookies', u'./cookies.txt', u'--yes-playlist', u'https://www.learner.org/series/french-in-action/transportation-and-travel-ii/']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2020.03.24
[debug] Python version 2.7.12 (CPython) - Linux-4.4.0-146-generic-x86_64-with-Ubuntu-16.04-xenial
[debug] exe versions: ffmpeg 2.8.15, ffprobe 2.8.15, rtmpdump 2.4
[debug] Proxy map: {}
[generic] transportation-and-travel-ii: Requesting header
Traceback (most recent call last):
  File "/usr/lib/python2.7/runpy.py", line 174, in _run_module_as_main
    "__main__", fname, loader, pkg_name)
  File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
    exec code in run_globals
  File "/usr/local/bin/youtube-dl/__main__.py", line 19, in <module>
  File "/usr/local/bin/youtube-dl/youtube_dl/__init__.py", line 474, in main
  File "/usr/local/bin/youtube-dl/youtube_dl/__init__.py", line 464, in _real_main
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 2019, in download
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 797, in extract_info
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 530, in extract
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/generic.py", line 2286, in _real_extract
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 627, in _request_webpage
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 2238, in urlopen
  File "/usr/lib/python2.7/urllib2.py", line 429, in open
    response = self._open(req, data)
  File "/usr/lib/python2.7/urllib2.py", line 447, in _open
    '_open', req)
  File "/usr/lib/python2.7/urllib2.py", line 407, in _call_chain
    result = func(*args)
  File "/usr/local/bin/youtube-dl/youtube_dl/utils.py", line 2728, in https_open
  File "/usr/lib/python2.7/urllib2.py", line 1195, in do_open
    h.request(req.get_method(), req.get_selector(), req.data, headers)
  File "/usr/lib/python2.7/httplib.py", line 1057, in request
    self._send_request(method, url, body, headers)
  File "/usr/lib/python2.7/httplib.py", line 1096, in _send_request
    self.putheader(hdr, value)
  File "/usr/lib/python2.7/httplib.py", line 1035, in putheader
    raise ValueError('Invalid header value %r' % (one_value,))
ValueError: Invalid header value '_ga=GA1.2.291941348.1587939605\r; _gid=GA1.2.2016242009.1587939605\r; __cfduid=da29c99c45c4074bf73b5b3eaf94c0a901587939605\r'
rwarford commented 4 years ago

The download worked when I ran youtube-dl on Ubuntu and used the link in the playlist JSON (found in the first XHR result in Chrome Developer Tools). So there appear to be two issues:

  1. youtube-dl is not able to correctly extract the video URL regardless of platform.
  2. youtube-dl is not able to download the video on Windows 7 (I know, I know).