search

ytdl-org / youtube-dl

Command-line program to download videos from YouTube.com and other video sites
http://ytdl-org.github.io/youtube-dl/
The Unlicense
130.17k stars 9.82k forks source link

Unable to download from SonyLIV anymore #16807

Closed theincognito-inc closed 6 years ago

theincognito-inc commented 6 years ago

What is the purpose of your issue?

If the purpose of this issue is a bug report, site support request or you are not completely sure provide the full verbose output as follows:

youtube-dl.exe -f hls-1425-1 --verbose https://www.sonyliv.com/details/highlights/5801057489001/Belgium-v-Tunisia---Full-Match-Highlights---2018-FIFA-World-Cup-Russia%E2%84%A2---23rd-June,-2018
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-f', 'hls-1425-1', '--verbose', 'https://www.sonyliv.com/details/highlights/5801057489001/Belgium-v-Tunisia---Full-Match-Highlights---2018-FIFA-World-Cup-Russia%E2%84%A2---23rd-June,-2018']
[debug] Encodings: locale cp1252, fs mbcs, out cp437, pref cp1252
[debug] youtube-dl version 2018.06.19
[debug] Python version 3.4.4 (CPython) - Windows-10-10.0.17134
[debug] exe versions: ffmpeg N-91266-g8c20ea8ee0, ffprobe N-91266-g8c20ea8ee0
[debug] Proxy map: {}
[debug] Using fake IP 117.249.95.141 (IN) as X-Forwarded-For.
[brightcove:new] ref:5801057489001: Downloading webpage
[brightcove:new] ref:5801057489001: Downloading JSON metadata
[brightcove:new] ref:5801057489001: Downloading m3u8 information
[brightcove:new] ref:5801057489001: Downloading m3u8 information
[brightcove:new] ref:5801057489001: Downloading MPD manifest
[brightcove:new] ref:5801057489001: Downloading MPD manifest
[debug] Invoking downloader on 'https://manifest.prod.boltdns.net/manifest/v1/hls/v5/fairplay/5182475815001/a242d18c-d5ad-41d2-8b67-1a87506f9e22/fa13e0cb-8eb5-41e5-9276-e58e6510f956/10s/rendition.m3u8?fastly_token=NWI1MzUxOWFfOGJiZjJkYTI4NDdhMTYxZTFkYzBkZTAzZmQ3NDJiNjBiY2U0NmM4NzE0YmY5NmM1NDEyNmQwZGQxYThkZDAwNg%3D%3D'
[hlsnative] Downloading m3u8 manifest
WARNING: hlsnative has detected features it does not support, extraction will be delegated to ffmpeg
[download] Destination: Belgium v Tunisia - Full Match Highlights - 2018 FIFA World Cup Russia™ - 23rd June, 2018-ref -5801057489001.mp4
[debug] ffmpeg command line: ffmpeg -y -loglevel verbose -headers "Referer: https://www.sonyliv.com/details/highlights/5801057489001/Belgium-v-Tunisia---Full-Match-Highlights---2018-FIFA-World-Cup-Russia%E2%84%A2---23rd-June,-2018
Accept: application/json;pk=BCpkADawqM02W6TiRrTFe6c8BetqgXni7KF_ebunAEbo3mafsvAFceEBMsoyqnwDq6DDk906ySKPwGAwygz-e2lTeWFKffwi7DkTLUE8fkPU5F-SUb4LUg2XL1Lv5vgzWOYH12kgTNpO5DJM
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:59.0) Gecko/20100101 Firefox/59.0 (Chrome)
X-Forwarded-For: 117.249.95.141
Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
Accept-Encoding: gzip, deflate
Accept-Language: en-us,en;q=0.5
Origin: https://www.sonyliv.com
" -i "https://manifest.prod.boltdns.net/manifest/v1/hls/v5/fairplay/5182475815001/a242d18c-d5ad-41d2-8b67-1a87506f9e22/fa13e0cb-8eb5-41e5-9276-e58e6510f956/10s/rendition.m3u8?fastly_token=NWI1MzUxOWFfOGJiZjJkYTI4NDdhMTYxZTFkYzBkZTAzZmQ3NDJiNjBiY2U0NmM4NzE0YmY5NmM1NDEyNmQwZGQxYThkZDAwNg%3D%3D" -c copy -f mp4 "file:Belgium v Tunisia - Full Match Highlights - 2018 FIFA World Cup Russia™ - 23rd June, 2018-ref -5801057489001.mp4.part"
ffmpeg version N-91266-g8c20ea8ee0 Copyright (c) 2000-2018 the FFmpeg developers
  built with gcc 7.3.0 (GCC)
 configuration: --enable-gpl --enable-version3 --enable-sdl2 --enable-bzlib --enable-fontconfig --enable-gnutls --enable-iconv --enable-libass --enable-libbluray --enable-libfreetype --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-libopus --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libtheora --enable-libtwolame --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxml2 --enable-libzimg --enable-lzma --enable-zlib --enable-gmp --enable-libvidstab --enable-libvorbis --enable-libvo-amrwbenc --enable-libmysofa --enable-libspeex --enable-libxvid --enable-libaom --enable-libmfx --enable-amf --enable-ffnvcodec --enable-cuvid --enable-d3d11va --enable-nvenc --enable-nvdec --enable-dxva2 --enable-avisynth
  libavutil      56. 18.102 / 56. 18.102
  libavcodec     58. 20.101 / 58. 20.101
  libavformat    58. 17.100 / 58. 17.100
  libavdevice    58.  4.100 / 58.  4.100
  libavfilter     7. 25.100 /  7. 25.100
  libswscale      5.  2.100 /  5.  2.100
  libswresample   3.  2.100 /  3.  2.100
  libpostproc    55.  2.100 / 55.  2.100
[hls,applehttp @ 0000025cd4f1b380] HLS request for url 'https://bcboltsony-a.akamaihd.net/media/v1/hls/v5/fairplay/5182475815001/a242d18c-d5ad-41d2-8b67-1a87506f9e22/fa13e0cb-8eb5-41e5-9276-e58e6510f956/a61a95d0-1ed2-43af-86e3-01cfd1f7a0f7/5x/segment0.ts?akamai_token=exp=1532187057~acl=/media/v1/hls/v5/fairplay/5182475815001/a242d18c-d5ad-41d2-8b67-1a87506f9e22/fa13e0cb-8eb5-41e5-9276-e58e6510f956/a61a95d0-1ed2-43af-86e3-01cfd1f7a0f7/*~hmac=384633bd220f99f066bf204b478a8c1fbeca9fd7d476657b51b32e35b17f6e67', offset 0, playlist 0
[hls,applehttp @ 0000025cd4f1b380] SAMPLE-AES encryption is not supported yet
[hls,applehttp @ 0000025cd4f1b380] Failed to open segment 0 of playlist 0
[hls,applehttp @ 0000025cd4f1b380] HLS request for url 'https://bcboltsony-a.akamaihd.net/media/v1/hls/v5/fairplay/5182475815001/a242d18c-d5ad-41d2-8b67-1a87506f9e22/fa13e0cb-8eb5-41e5-9276-e58e6510f956/a61a95d0-1ed2-43af-86e3-01cfd1f7a0f7/5x/segment1.ts?akamai_token=exp=1532187057~acl=/media/v1/hls/v5/fairplay/5182475815001/a242d18c-d5ad-41d2-8b67-1a87506f9e22/fa13e0cb-8eb5-41e5-9276-e58e6510f956/a61a95d0-1ed2-43af-86e3-01cfd1f7a0f7/*~hmac=384633bd220f99f066bf204b478a8c1fbeca9fd7d476657b51b32e35b17f6e67', offset 0, playlist 0
[hls,applehttp @ 0000025cd4f1b380] SAMPLE-AES encryption is not supported yet
....
7f6e67', offset 0, playlist 0
[hls,applehttp @ 0000025cd4f1b380] SAMPLE-AES encryption is not supported yet
[hls,applehttp @ 0000025cd4f1b380] Failed to open segment 88 of playlist 0
[hls,applehttp @ 0000025cd4f1b380] Error when loading first segment 'https://bcboltsony-a.akamaihd.net/media/v1/hls/v5/fairplay/5182475815001/a242d18c-d5ad-41d2-8b67-1a87506f9e22/fa13e0cb-8eb5-41e5-9276-e58e6510f956/a61a95d0-1ed2-43af-86e3-01cfd1f7a0f7/5x/segment0.ts?akamai_token=exp=1532187057~acl=/media/v1/hls/v5/fairplay/5182475815001/a242d18c-d5ad-41d2-8b67-1a87506f9e22/fa13e0cb-8eb5-41e5-9276-e58e6510f956/a61a95d0-1ed2-43af-86e3-01cfd1f7a0f7/*~hmac=384633bd220f99f066bf204b478a8c1fbeca9fd7d476657b51b32e35b17f6e67'
https://manifest.prod.boltdns.net/manifest/v1/hls/v5/fairplay/5182475815001/a242d18c-d5ad-41d2-8b67-1a87506f9e22/fa13e0cb-8eb5-41e5-9276-e58e6510f956/10s/rendition.m3u8?fastly_token=NWI1MzUxOWFfOGJiZjJkYTI4NDdhMTYxZTFkYzBkZTAzZmQ3NDJiNjBiY2U0NmM4NzE0YmY5NmM1NDEyNmQwZGQxYThkZDAwNg%3D%3D: Invalid data found when processing input

ERROR: ffmpeg exited with code 1
  File "__main__.py", line 19, in <module>
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp3niajf93\build\youtube_dl\__init__.py", line 472, in main
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp3niajf93\build\youtube_dl\__init__.py", line 462, in _real_main
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp3niajf93\build\youtube_dl\YoutubeDL.py", line 2001, in download
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp3niajf93\build\youtube_dl\YoutubeDL.py", line 803, in extract_info
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp3niajf93\build\youtube_dl\YoutubeDL.py", line 864, in process_ie_result
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp3niajf93\build\youtube_dl\YoutubeDL.py", line 803, in extract_info
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp3niajf93\build\youtube_dl\YoutubeDL.py", line 857, in process_ie_result
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp3niajf93\build\youtube_dl\YoutubeDL.py", line 1635, in process_video_result
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp3niajf93\build\youtube_dl\YoutubeDL.py", line 1908, in process_info
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp3niajf93\build\youtube_dl\YoutubeDL.py", line 1847, in dl
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp3niajf93\build\youtube_dl\downloader\common.py", line 364, in download
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp3niajf93\build\youtube_dl\downloader\hls.py", line 76, in real_download
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp3niajf93\build\youtube_dl\downloader\external.py", line 64, in real_download
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp3niajf93\build\youtube_dl\downloader\common.py", line 165, in report_error
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp3niajf93\build\youtube_dl\YoutubeDL.py", line 620, in report_error
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp3niajf93\build\youtube_dl\YoutubeDL.py", line 582, in trouble

Description of your issue, suggested solution and other information

This video is playable through my browser. In the log, I see that its using fake IP for India, even though I live in India and I can access this site without any proxy or VPN. I am a premium member of the site too, if it helps. Also, I did the latest git pull and tried downloading. Same result was observed.

theincognito-inc commented 6 years ago

I tried with --no-geo-bypass and the same error is observed. @dstftw

theincognito-inc commented 6 years ago

@remitamine It's working now. I did the pull. Thanks a lot! 👍

avisihag commented 3 years ago

you need to use the following: youtube-dl --add-header "x-playback-session-id: THEXPLAYBACKID" "MPDLINK" Just replace THEXPLAYBACKID and MPDLINK by searching for the respective data in the network tab in developer mode. You can open it by pressing f12. Don't forget to reload the site after that and simply search mpd and x-playback-session-id