search

ytdl-org / youtube-dl

Command-line program to download videos from YouTube.com and other video sites
http://ytdl-org.github.io/youtube-dl/
The Unlicense
132k stars 10.01k forks source link

[discovery] "GO" Channels have been discontinued #14954

Closed StevenDTX closed 6 years ago

StevenDTX commented 6 years ago

Please follow the guide below

Make sure you are using the latest version: run youtube-dl --version and ensure your version is 2017.12.10. If it's not, read this FAQ entry and update. Issues with outdated version will be rejected.

Before submitting an issue make sure you have:

What is the purpose of your issue?

The following sections concretize particular purposed issues, you can erase any section (the contents between triple ---) not applicable to your issue

If the purpose of this issue is a bug report, site support request or you are not completely sure provide the full verbose output as follows:

Add the -v flag to your command line you run youtube-dl with (youtube-dl -v <your command line>), copy the whole output and insert it here. It should look similar to one below (replace it with your log inserted between triple ```):

E:\>youtube-dl https://www.discovery.com/tv-shows/gold-rush/full-episodes/gold-bars-and-hail-marys --verbose
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['https://www.discovery.com/tv-shows/gold-rush/full-episodes/gold-bars-and-hail-marys', '--verbose']
[debug] Encodings: locale cp1252, fs mbcs, out cp437, pref cp1252
[debug] youtube-dl version 2017.12.10
[debug] Python version 3.4.4 - Windows-10-10.0.14393
[debug] exe versions: ffmpeg N-89395-g71421f382f, ffprobe N-72383-g7206b94, rtmpdump 2.4
[debug] Proxy map: {}
[Discovery] gold-bars-and-hail-marys: Downloading JSON metadata
ERROR: gold-bars-and-hail-marys: Failed to parse JSON  (caused by ValueError('Expecting value: line 1 column 1 (char 0)',)); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
Traceback (most recent call last):
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp9arpqqmf\build\youtube_dl\extractor\common.py", line 686, in _parse_json
  File "C:\Python\Python34\lib\json\__init__.py", line 318, in loads
  File "C:\Python\Python34\lib\json\decoder.py", line 343, in decode
  File "C:\Python\Python34\lib\json\decoder.py", line 361, in raw_decode
ValueError: Expecting value: line 1 column 1 (char 0)
Traceback (most recent call last):
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp9arpqqmf\build\youtube_dl\extractor\common.py", line 686, in _parse_json
  File "C:\Python\Python34\lib\json\__init__.py", line 318, in loads
  File "C:\Python\Python34\lib\json\decoder.py", line 343, in decode
  File "C:\Python\Python34\lib\json\decoder.py", line 361, in raw_decode
ValueError: Expecting value: line 1 column 1 (char 0)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp9arpqqmf\build\youtube_dl\YoutubeDL.py", line 784, in extract_info
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp9arpqqmf\build\youtube_dl\extractor\common.py", line 437, in extract
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp9arpqqmf\build\youtube_dl\extractor\discovery.py", line 67, in _real_extract
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp9arpqqmf\build\youtube_dl\extractor\common.py", line 680, in _download_json
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp9arpqqmf\build\youtube_dl\extractor\common.py", line 690, in _parse_json
youtube_dl.utils.ExtractorError: gold-bars-and-hail-marys: Failed to parse JSON  (caused by ValueError('Expecting value: line 1 column 1 (char 0)',)); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
...
<end of log>

If the purpose of this issue is a site support request please provide all kinds of example URLs support for which should be included (replace following example URLs by yours):

Description of your issue, suggested solution and other information

All of the Discovery "GO" channels (discoverygo.com, tlcgo.com, animalplanetgo.com, etc) are being discontinued. They have moved all of the Full Episodes to the non-GO channels (discovery.com, tlc.com, animalplanet.com, etc).

The current [discovery] extractor does not work on these sites.

They also have lowered the quality of the videos on the GO channels to 720p. It appears that the 1080p videos are available on the non-GO channels.

Thanks.!

ghost commented 6 years ago

@cookieguru @tindivall

./ffmpeg -i "https://content-ause1.uplynk.com/40210e12696c4fa9b40509ede02e6a52/i.m3u8#UPLYNK-MEDIA0:192x108x15,baseline-11,2x48000#EXT-X-STREAM-INF:PROGRAM-" -acodec copy -bsf:a aac _adtstoasc -vcodec copy "seenoevil.mkv" ffmpeg version N-89832-g07a96b6251 Copyright (c) 2000-2018 the FFmpeg developers built with gcc 7.2.0 (GCC) configuration: --enable-gpl --enable-version3 --enable-sdl2 --enable-bzlib --enable-fontconfig --enable-gnutls --enable-iconv --enable-libass --enable-libbluray --enable-libfreetype --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-libopus --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libtheora --enable-libtwolame --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxml2 --enable-libzimg --enable-lzma --enable-zlib --enable-gmp --enable-libvidstab --enable-libvorbis --enable-libvo-amrwbenc --enable-libmysofa --enable-libspeex --enable-libmfx --enable-amf --enable-cuda --enable-cuvid --enable-d3d11va --enable-nvenc --enable-dxva2 --enable-avisynth libavutil 56. 7.100 / 56. 7.100 libavcodec 58. 9.100 / 58. 9.100 libavformat 58. 5.100 / 58. 5.100 libavdevice 58. 0.100 / 58. 0.100 libavfilter 7. 11.101 / 7. 11.101 libswscale 5. 0.101 / 5. 0.101 libswresample 3. 0.101 / 3. 0.101 libpostproc 55. 0.100 / 55. 0.100 [https @ 0000024e3cf0aa80] HTTP error 404 Not Found https://content-ause1.uplynk.com/40210e12696c4fa9b40509ede02e6a52/i.m3u8#UPLYNK-MEDIA0:192x108x15,baseline-11,2x48000#EXT-X-STREAM-INF:PROGRAM-: Server returned 404 Not Found

tindivall commented 6 years ago

@captbanana This will probably be my last response, I tried to find a way to pm you so we don't continue to distract from the point of this post....

When you download the m3u8 file and open it (I used wordpad) there are several links for the different aspect ratio... so as an example the one I have open has

UPLYNK-MEDIA0:1920x1080x30,high-40,2x48000

EXT-X-STREAM-INF:PROGRAM-ID=1,RESOLUTION=1920x1080,BANDWIDTH=6669226,CODECS="mp4a.40.5,avc1.640028",FRAME-RATE=30.000,AUDIO="aac",AVERAGE-BANDWIDTH=5229760

after that begins the http for that 1920x1080 resolution... copy the entire link from the beginning of the http until right before the next #uplynk-media

ghost commented 6 years ago

@tindivall I'll see if there is a way to pm you. Did what you said to do and I get "Unable to open key file" after it says: opening'crypto+https://stgec-ausw-tmp.uplynk.com/80C078/ausw/slices/402/e6cf0c55dac249f0a0f72e7c72e6f6cb/40210e12696c4fa9b40509ede02e6a52/I00000000.ts?x=0&si=0' for reading [hls,applehttp @ 00000264864b99c0] Opening 'crypto+https://stgec-ausw-tmp.uplynk.com/80C078/ausw/slices/402/e6cf0c55dac249f0a0f72e7c72e6f6cb/40210e12696c4fa9b40509ede02e6a52/I00000001.ts?x=0&si=0' for reading [hls,applehttp @ 00000264864b99c0] Error when loading first segment 'https://stgec-ausw-tmp.uplynk.com/80C078/ausw/slices/402/e6cf0c55dac249f0a0f72e7c72e6f6cb/40210e12696c4fa9b40509ede02e6a52/I00000000.ts?x=0&si=0' https://content-ause1.uplynk.com/40210e12696c4fa9b40509ede02e6a52/i.m3u8: Invalid data found when processing input

ghost commented 6 years ago

A:\YoutubeDL>ffmpeg -i "https://content-ausw4.uplynk.com/db84d9da90474fc1a52a9570283cc846/h.m3u8" -acodec copy -bsf:a aac_adtstoasc -vcodec copy "test.mkv" ffmpeg version N-88042-g72c3d9ae45 Copyright (c) 2000-2017 the FFmpeg developers built with gcc 7.2.0 (GCC) configuration: --enable-gpl --enable-version3 --enable-sdl2 --enable-bzlib --enable-fontconfig --enable-gnutls --enable-iconv --enable-libass --enable-libbluray --enable-libfreetype --enable-libmp3lame --enable-libopenjpeg --enable-libopus --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libtheora --enable-libtwolame --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxml2 --enable-libzimg --enable-lzma --enable-zlib --enable-gmp --enable-libvidstab --enable-libvorbis --enable-cuda --enable-cuvid --enable-d3d11va --enable-nvenc --enable-dxva2 --enable-avisynth --enable-libmfx libavutil 56. 0.100 / 56. 0.100 libavcodec 58. 0.100 / 58. 0.100 libavformat 58. 0.100 / 58. 0.100 libavdevice 58. 0.100 / 58. 0.100 libavfilter 7. 0.100 / 7. 0.100 libswscale 5. 0.100 / 5. 0.100 libswresample 3. 0.100 / 3. 0.100 libpostproc 55. 0.100 / 55. 0.100 [hls,applehttp @ 0000020d7a742060] Opening 'https://content-ausw4.uplynk.com/check2?b=db84d9da90474fc1a52a9570283cc846&v=db84d9da90474fc1a52a9570283cc846&r=h' for reading [https @ 0000020d78f4cf80] HTTP error 403 Forbidden Unable to open key file https://content-ausw4.uplynk.com/check2?b=db84d9da90474fc1a52a9570283cc846&v=db84d9da90474fc1a52a9570283cc846&r=h [hls,applehttp @ 0000020d7a742060] Opening 'crypto+https://stgec-ausw-tmp.uplynk.com/80C078/ausw/slices/db8/e6cf0c55dac249f0a0f72e7c72e6f6cb/db84d9da90474fc1a52a9570283cc846/H00000000.ts?x=0&si=0' for reading [hls,applehttp @ 0000020d7a742060] Error when loading first segment 'https://stgec-ausw-tmp.uplynk.com/80C078/ausw/slices/db8/e6cf0c55dac249f0a0f72e7c72e6f6cb/db84d9da90474fc1a52a9570283cc846/H00000000.ts?x=0&si=0' https://content-ausw4.uplynk.com/db84d9da90474fc1a52a9570283cc846/h.m3u8: Invalid data found when processing input

I'm also getting that Unable to open key file? Checked and using same ip, recieve the original m3u and get 1080 and 720 link but nothing works

ghost commented 6 years ago

@Hemps37 Are you trying to download from investigation discovery? I am getting the same error message too. Hopefully it will be fixed soon.

Mr-Jake commented 6 years ago

@Hemps37 It doesn't work because you are not using the correct link.

Where are all the parameters after h.m3u8 ? It looks like you did not copy and paste the entire link. All the parameters after the .m3u8 are needed for authentication.

ghost commented 6 years ago

@Mr-Jake

It doesn't work because you are not using the correct link.

Could you post exactly how the correct link should look (verbatim) in FFmpeg?

Can FFmpeg download the subtitles too for each episode?

tindivall commented 6 years ago

Step 1 you install the script in something like tampermonkey

Step 2 you get the link from the site...

Step 3 You then take that link and put it in your browser that will download a m3u8 file.

Step 4 Go open that file (I use wordpad)... and then look for the resolution you want to download in. I like the 1920x1080 so I find that in the file and then coy the link after it...

(I went to discovery just now and grabbed I think gold rush or something...)... in the m3u8 file I found the 1920x1080... the link for it would then be:

https://content-ausw1.uplynk.com/0063a36144be45c89a40ad907fe3dbae/i.m3u8?tc=1&exp=1521742824&rn=1804088552&ct=a&cid=0063a36144be45c89a40ad907fe3dbae&ad.customer_id=&ad.nw=&ad.prof=&ad.csid=&ad.caid=&ad.vip=(XXXXXX)&pp2ip=0&ad.cping=1&ad=fw&ad.pingf=3&rays=cdefghiba&v=2&sig=a288e30c033e8e95034b8fe3d33f35729ef39bdb4b459a0b54e91cbf09fa090c&pbs=883336b6329c48af88cf95849c0958ca

The link will start with https (after the bandwidth number) and it will end before the next #UPLYNK

The (XXXXXX) part I changed because that contains IP address you won't be able to copy/paste what I posted and it work, it will have to be from your computer.

Step 5... you take that link and put it into the ffmep -i code that was posted way up above.

cookieguru commented 6 years ago

@captbanana

Could you post exactly how the correct link should look (verbatim) in FFmpeg?

It has already been discussed in this issue, which is supposed to be about fixing youtube-dl and not downloading files with ffmpeg.

Can FFmpeg download the subtitles too for each episode?

Again, already here, scroll up

dare2 commented 6 years ago

Yeah, so about fixing youtube-dl...who wants to step up to the plate? I would if I could. :)

It's only been over 3 months now.

cookieguru commented 6 years ago

@dare2 The details are here. Just modify the code and run it. If it works, commit it and bask in the glory of being the hero.

dare2 commented 6 years ago

Wish I could. Don't have python nor linux, my job precludes me from taking the time to learn it, install it, etc.

cookieguru commented 6 years ago

@Dare2 You don't need Linux. Installing Python is as easy as installing any other program. Not much to learn here; just find another extractor that works, copy it, try it.

ghost commented 6 years ago

@tindivall I think I read your post carefully, however; I get the following message. Does it look correct?

./ffmpeg -i https://content.uplynk.com/40210e12696c4fa9b40509ede02e6a52.m3u8?tc=1&e xp=1521770576&rn=2092187663&ct=a&cid=40210e12696c4fa9b40509ede02e6a52&ad.customer_id=&ad.nw=&ad.prof=&ad.csid=&ad.caid=& ad.vip=XXX.XX.XX.XX&pp2ip=0&ad.cping=1&ad=fw&ad.pingf=3&rays=cdefghiba&v=2&sig=441e6d3071ed2f8f007277c558fbceb02d8569b4b 3079e09a80b3a5312d06da9 -acodec copy -bsf:a aac_adtstoasc -vcodec copy "filename.mkv" At line:1 char:82

ghost commented 6 years ago

A:\YoutubeDL>ffmpeg -i "https://content-ausc3.uplynk.com/36b4f4e378524657b20a7b3932dc9ee5/c.m3u8?tc=1&exp=1521787025&rn=167841857&ct=a&cid=36b4f4e378524657b20a7b3932dc9ee5&ad.customer_id=&ad.nw=&ad.prof=&ad.csid=&ad.caid=&ad.vip=XXX.XX.xXX.XXX&pp2ip=0&ad.cping=1&ad=fw&ad.pingf=3&rays=cdefghiba&v=2&sig=fdaef724aba6e467ddaf8ee811e10bed924b4d285cbdc81bedcc4d092ed1123b&pbs=85d8df28e7a949569c6c9e7ab72b9ca5" -acodec copy -bsf:a aac_adtstoasc -vcodec copy "filename.mkv"

This finally worked for me

You can also use Internet download Manager to get your desired link, then paste the full link and use ffmpeg. So you dont have to download m3u file and open with Wordpad.

dare2 commented 6 years ago

If it's so easy, then I would think it would have been tried and/or fixed by now.

ghost commented 6 years ago

./ffmpeg -i "https://content-ause4.uplynk.com/40210e12696c4fa9b40509ede02e6a52/h.m3u8?tc=1&exp=1521815204&rn=69499346&ct=a&cid=40210e12696c4fa9b40509ede02e6a52&ad.customer_id=&ad.nw=&ad.prof=&ad.csid=&ad.caid=&ad.vip=XXX.XX.XX.2&pp2ip=0&ad.cping=1&ad=fw&ad.pingf=3&rays=cdefghiba&v=2&sig=7cc94d4540e71d65f39021bc9483530ed45584f5ab1da5881d964412b858f921 -acodec copy -bsf:a aac_adtstoasc -vcodec copy" filename.mkv ffmpeg version N-90399-ged0e0fe102 Copyright (c) 2000-2018 the FFmpeg developers built with gcc 7.3.0 (GCC) configuration: --enable-gpl --enable-version3 --enable-sdl2 --enable-bzlib --enable-fontconfig --enable-gnutls --enable-iconv --enable-libass --enable-libbluray --enable-libfreetype --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-libopus --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libtheora --enable-libtwolame --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxml2 --enable-libzimg --enable-lzma --enable-zlib --enable-gmp --enable-libvidstab --enable-libvorbis --enable-libvo-amrwbenc --enable-libmysofa --enable-libspeex --enable-libxvid --enable-libmfx --enable-amf --enable-ffnvcodec --enable-cuvid --enable-d3d11va --enable-nvenc --enable-nvdec --enable-dxva2 --enable-avisynth libavutil 56. 11.100 / 56. 11.100 libavcodec 58. 15.100 / 58. 15.100 libavformat 58. 10.100 / 58. 10.100 libavdevice 58. 2.100 / 58. 2.100 libavfilter 7. 13.100 / 7. 13.100 libswscale 5. 0.102 / 5. 0.102 libswresample 3. 0.101 / 3. 0.101 libpostproc 55. 0.100 / 55. 0.100 [hls,applehttp @ 000002093b4aa2c0] Opening 'https://content-ause4.uplynk.com/check2?b=40210e12696c4fa9b40509ede02e6a52&v=40210e12696c4fa9b40509ede02e6a52&r=h' for reading [https @ 000002093b578040] HTTP error 403 Forbidden Unable to open key file https://content-ause4.uplynk.com/check2?b=40210e12696c4fa9b40509ede02e6a52&v=40210e12696c4fa9b40509ede02e6a52&r=h [hls,applehttp @ 000002093b4aa2c0] Opening 'crypto+https://stgec-ausw-tmp.uplynk.com/80C078/ausw/slices/402/e6cf0c55dac249f0a0f72e7c72e6f6cb/40210e12696c4fa9b40509ede02e6a52/H00000000.ts?x=0&si=0' for reading [hls,applehttp @ 000002093b4aa2c0] Opening 'crypto+https://stgec-ausw-tmp.uplynk.com/80C078/ausw/slices/402/e6cf0c55dac249f0a0f72e7c72e6f6cb/40210e12696c4fa9b40509ede02e6a52/H00000001.ts?x=0&si=0' for reading [hls,applehttp @ 000002093b4aa2c0] Error when loading first segment 'https://stgec-ausw-tmp.uplynk.com/80C078/ausw/slices/402/e6cf0c55dac249f0a0f72e7c72e6f6cb/40210e12696c4fa9b40509ede02e6a52/H00000000.ts?x=0&si=0' https://content-ause4.uplynk.com/40210e12696c4fa9b40509ede02e6a52/h.m3u8?tc=1&exp=1521815204&rn=69499346&ct=a&cid=40210e12696c4fa9b40509ede02e6a52&ad.customer_id=&ad.nw=&ad.prof=&ad.csid=&ad.caid=&ad.vip=196.52.39.2&pp2ip=0&ad.cping=1&ad=fw&ad.pingf=3&rays=cdefghiba&v=2&sig=7cc94d4540e71d65f39021bc9483530ed45584f5ab1da5881d964412b858f921 -acodec copy -bsf:a aac_adtstoasc -vcodec copy: Invalid data found when processing input

cookieguru commented 6 years ago

If it's so easy, then I would think it would have been tried and/or fixed by now.

This is a strange statement coming from someone that is unwilling to put forth even the slightest effort in to fixing it.

ghost commented 6 years ago

I was able to download 1 episode last night using youtube-dl. However; when I tried other episodes it wouldn't work. I know nothing about Python or coding. Is the "architecture" different from the once IDGO website vs the Investigation Discovery - Official Site? The IDGO website worked flawlessly with youtube-dl..(I think). Why did youtube-dl work for 1 episode on the Investigation Discovery - Official Site but not the others? Couldn't someone that knows Python like the back of their hand see what made youtube-dl work with that 1 episode and incorporate the rest of that code into youtube-dl?

cookieguru commented 6 years ago

@captbanana That's not how open source works. There's not a group of people around just waiting to fix things. Being well versed in Python is not a prerequisite for contributing nor even reading the source code. People contribute because they have built something useful and want to share it with others and not because they're compelled to execute every bug fix brought up by users. (Also: this isn't a ffmpeg support thread).

I don't visit the ID site, but I do grab a bunch of shows off Discovery and Science. The backend service that generates the m3u8 links seems to be agnostic to which brand the shows are airing on. The current implementation generally works for videos that do not require a cable subscription. I have #15455 pending which should add a bit more reliability to that, but it doesn't include the --ap-mso flags. The perpetuous demands of "please fix it" without any offer to contribute are a significant demotivator for doing so.

Mr-Jake commented 6 years ago

Did Discovery break their website? I tried multiple versions of Firefox including the current version and multiple computers. None of the menu navigation works, the layout has missing elements, and I can't click to access any of the shows. Can anyone confirm?

I was going to try to work on youtube-dl this weekend and I can't navigate any Discovery site for the past week.

cookieguru commented 6 years ago

@Mr-Jake Turn off your ad blocker

ghost commented 6 years ago

@Mr-Jake If you're stilling having problems navigating Discovery's website, try disabling your VPN. (If you have one running).

Mr-Jake commented 6 years ago

@cookieguru @captbanana

Do the Discovery sites work for you using Firefox?

I don't use any ad blocker or VPN and I even did a new clean install of Firefox 59 on a new laptop. Everything factory new with default settings. No luck with IE10 either on another computer. Anytime I click on any navigation nothing happens. The only link that works is the Schedule link, no drop down menus work. Only the Discovery sites have this problem, every other site I tried works.

Back to youtube-dl, I was working on --ap-username --ap-password. I actually got it working for Comcast login for the A&E network sites (History Channel), but still no luck with Discovery. There were a number of pull requests that were never committed, but they actually fixed the authentication for a number of sites when I compiled them.

StevenDTX commented 6 years ago

I used FF earlier today to get the links for about a dozen episodes form Discovery and Animal Planet.

cookieguru commented 6 years ago

@Mr-Jake Do you see any errors in the JS console?

Back to youtube-dl do you know how get the proper OAuth token when authenticated? If not I can help with some direction.

ghost commented 6 years ago

@Mr-Jake All tabs works for me on Investigation Discovery - Official Site. I tired it on both Google Chrome 65.0.3325.181 (Official Build) (64-bit) and FireFox 59.0.1 (64-bit).

@StevenDTX - Did you download from Investigation Discovery - Official Site?

Mr-Jake commented 6 years ago

@cookieguru Thanks for the tip. From the console, I determined the tracker protection in Firefox was breaking the site. Once I disabled it, the navigation works.

Both Discovery and History appear to be using the same cable provider login authentication for Comcast. From the code changes I compiled, I got youtube-dl to authenticate and download videos from History. My plan is to debug the authentication of both sites to determine why Discovery fails and why History succeeds.

The Pull Request that I compiled that fixed authentication with History is https://github.com/rg3/youtube-dl/pull/11080 by raleeper.

cookieguru commented 6 years ago

@Mr-Jake If I'm not mistaken, Discovery fails because of this.

Not sure if you know about them already but the --write-pages and --print-traffic switches should prove useful.

ghost commented 6 years ago

I was just wondering how Youtube-dl is coming to support the Discovery sites? Since I am the only person that cannot download using FFmpeg with the m3u8 file, ( I keep getting errors) could someone be kind enough and video record your screen with the step-by-step tutorial and upload that video to Youtube or to another platform so I can see what I am doing wrong? Perhaps I am doing everything correct and its still not working? - Happy Easter!

Mr-Jake commented 6 years ago

I tried to fix the authentication for Discovery, but in end did not have any luck. While I was attempting to fix it, I found a solution to authenticate A&E networks (History Channel, etc) for Comcast login. I was also successful at restoring HTTP 720p downloads for A&E networks. I'm not sure why the extractor was recently changed to HLS since HTTP is still available. HTTP is better since no remux is needed.

--cookies does not work for any site I try, while I used to use it all the time in the past. Since it is broken for all sites I tried, I wonder if a commit broke it. When I have time I will look back to see if commit is to blame.

ghost commented 6 years ago

@Mr-Jake Thank you for your effort. --cookies doesn't work for me either, however; it did in the past. I use the DirecTV login, so I don't know if Youtube-dl will work for me with A&E networks (History Channel, etc) or TLC.

cookieguru commented 6 years ago

--cookies does not work for any site I try, while I used to use it all the time in the past. Since it is broken for all sites I tried, I wonder if a commit broke it. When I have time I will look back to see if commit is to blame.

I can only speak for the Discovery sites but can say with 100% certainty that the reason it works has nothing to do with youtube-dl and everything to do with Discovery's site. Previously, Discovery sent the URL to the playlist file with the webpage on all authenticated requests. Now the URL to the playlist is hidden behind a separate endpoint that the browser requests when the page is first loaded in the browser. This requires a separate set of cookies that is unrelated to the Adobe Pass cookies, and you have to be authenticated to get the cookies that the endpoint needs.

ghost commented 6 years ago

Anyone know how to get ffmpeg to download from links stored in a txt file?

cookieguru commented 6 years ago

@hemps37 http://lmgtfy.com/?q=ffmpeg+download+from+links+stored+in+a+txt+file

This issue is only for discussion related to fixing youtube-dl. It is not a ffmpeg support forum

lemstress commented 6 years ago

Bumping this. I wish I could help. Having the exact same problem with some TLC shows, as it's a Discovery site. What's odd is some older episodes work fine, but I feel like it's newer episodes of shows that have this issue where youtube-dl is asking for cookies and the adobe pass isn't working.

StevenDTX commented 6 years ago

Thanks, @remitamine. It works great with cookies.

beren12 commented 6 years ago

@cookieguru Hmm I think discovery changed the site again, I can't seem to get the playlist... Maybe it's me doing it wrong?

cookieguru commented 6 years ago

@beren12 I checked a couple of episodes and they still load fine for me

besweeet commented 5 years ago

I used the Tampermonkey script to download the full URL for the main manifest M3U8. I then replaced the beginning portion with i.m3u8 (1080p). I then took the full i.m3u8 URL and the download in both FFmpeg and Streamlink fail due to the lack of authorization (403) for check2, just like https://github.com/rg3/youtube-dl/issues/14954#issuecomment-375222254.

Has Discovery defeated us?

cookieguru commented 5 years ago

@besweeet youtube-dl has been uploaded; why are you still using the userscript?

besweeet commented 5 years ago

@cookieguru youtube-dl, when just providing a URL (example: https://www.sciencechannel.com/tv-shows/outrageous-acts-of-science/full-episodes/savage-skills), throws the following error: ERROR: This video is only available via cable service provider subscription that is not currently supported. You may want to use --cookies

It was said here that the --cookies method does not work.

cookieguru commented 5 years ago

https://github.com/rg3/youtube-dl/issues/14954#issuecomment-386837368

besweeet commented 5 years ago

@cookieguru All good now. Was using an incognito tab when exporting cookies with the cookies.txt Chrome extension which may not have included everything.

nairobi1982 commented 5 years ago

@cookieguru the script is broken, kindly fix it. sent you an e-mail of the script. Thanks.

StevenDTX commented 5 years ago

@cookieguru the script is broken, kindly fix it. sent you an e-mail of the script. Thanks.

You shouldnt be using @cookieguru userscript. All of the Discovery channels work just fine with youtube-dl if you use cookies.

nairobi1982 commented 5 years ago

@StevenDTX, how do I use the cookies in the you tube-dl? Do I use the you tube-dl GUI or the command option? I'm very raw in these techno savvy items.

nairobi1982 commented 5 years ago

@StevenDTX and @cookieguru , below is where I'm now stuck, how do I choose the best quality (1080p) to download:

C:\Users\user>C:\youtube-dl\youtube-dl.exe "https://www.sciencechannel.com/tv-shows/monster-black-hole-the-first-image/full-episodes/monster-black-hole-the-first-image" --cookies C:\youtube-dl\cookies.txt -F -v [debug] System config: [] [debug] User config: [] [debug] Custom config: [] [debug] Command-line args: ['https://www.sciencechannel.com/tv-shows/monster-black-hole-the-first-image/full-episodes/monster-black-hole-the-first-image', '--cookies', 'C:\youtube-dl\cookies.txt', '-F', '-v'] [debug] Encodings: locale cp1252, fs mbcs, out cp437, pref cp1252 [debug] youtube-dl version 2019.08.13 [debug] Python version 3.4.4 (CPython) - Windows-10-10.0.17134 [debug] exe versions: ffmpeg N-90480-ge5819fa629, ffprobe N-90480-ge5819fa629 [debug] Proxy map: {} [Discovery] monster-black-hole-the-first-image: Downloading content JSON metadata [Discovery] monster-black-hole-the-first-image: Downloading streaming JSON metadata [Discovery] monster-black-hole-the-first-image: Downloading m3u8 information [info] Available formats for 5cf6893b85aeee22b7423725: format code extension resolution note hls-62 mp4 96x54 62k , avc1.42000a, 6.0fps, mp4a.40.5 hls-134 mp4 192x108 134k , avc1.42000b, 15.0fps, mp4a.40.5 hls-243 mp4 288x162 243k , avc1.42000c, 15.0fps, mp4a.40.5 hls-449 mp4 448x252 449k , avc1.420015, 30.0fps, mp4a.40.5 hls-758 mp4 768x432 758k , avc1.4d001e, 30.0fps, mp4a.40.5 hls-1204 mp4 992x558 1204k , avc1.4d001f, 30.0fps, mp4a.40.5 hls-1874 mp4 1088x612 1874k , avc1.4d001f, 30.0fps, mp4a.40.5 hls-3265 mp4 1280x720 3265k , avc1.64001f, 30.0fps, mp4a.40.5 hls-5163 mp4 1920x1080 5163k , avc1.640028, 30.0fps, mp4a.40.5 (best)

C:\Users\user>

besweeet commented 5 years ago

@nairobi1982: Replace "-F -v" with "-f best". To choose a specific quality, replace "-f best" with "-f hls-449". In that example, it will download the 448x252 version. So, the format is "-f format" where you replace "format" with the code that you see at the start of each line. Hope that makes sense.

dare2 commented 5 years ago

I use this Chrome extension:

cookies.txt Offered by: Genuinous

https://chrome.google.com/webstore/detail/cookiestxt/njabckikapfpffapmjgojcnbfjonfjfg?hl=en

Copy the cookies from the extension into a text file (say, cookies.txt) and then pipe that file name into the yt-dl script with --cookies cookies.txt

...on a completely unrelated note, the latest episode of Battlebots from the discovery site does not download, instead it downloads a 2 minute ad for a TLC show. Playing the episode on the site works fine. Is anyone else seeing this issue?

https://go.discovery.com/tv-shows/battlebots/full-episodes/eyes-on-the-prize

EDIT: oops, I'm a little late to the party...but could someone check on my Battlebots issue?