search

ytdl-org / youtube-dl

Command-line program to download videos from YouTube.com and other video sites
http://ytdl-org.github.io/youtube-dl/
The Unlicense
132.16k stars 10.03k forks source link

extractor medici (medici.tv) #27208

Open switch6343 opened 3 years ago

switch6343 commented 3 years ago

cmd<!--

###################################################################### WARNING! IGNORING THE FOLLOWING TEMPLATE WILL RESULT IN ISSUE CLOSED AS INCOMPLETE ######################################################################

-->

Checklist

Verbose log

Microsoft Windows [Version 10.0.19042.630]
(c) 2020 Microsoft Corporation. All rights reserved.

C:\WINDOWS\system32>youtube-dl -v --hls-prefer-native https://www.medici.tv/en/concerts/sibelius-anne-sophie-mutter-andris-nelsons-orchestre-royal-du-concertgebouw/
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-v', '--hls-prefer-native', 'https://www.medici.tv/en/concerts/sibelius-anne-sophie-mutter-andris-nelsons-orchestre-royal-du-concertgebouw/']
[debug] Encodings: locale cp1252, fs mbcs, out cp850, pref cp1252
[debug] youtube-dl version 2020.11.26
[debug] Python version 3.4.4 (CPython) - Windows-10-10.0.19041
[debug] exe versions: ffmpeg N-100029-g040e989223, ffprobe N-100029-g040e989223
[debug] Proxy map: {}
[generic] sibelius-anne-sophie-mutter-andris-nelsons-orchestre-royal-du-concertgebouw: Requesting header
WARNING: Falling back on generic information extractor.
[generic] sibelius-anne-sophie-mutter-andris-nelsons-orchestre-royal-du-concertgebouw: Downloading webpage
[generic] sibelius-anne-sophie-mutter-andris-nelsons-orchestre-royal-du-concertgebouw: Extracting information
[generic] m: Downloading m3u8 information
[debug] Default format spec: bestvideo+bestaudio/best
[debug] Invoking downloader on 'https://sdn-global-streaming-cache.3qsdn.com/9378/files/20/11/2220797/9378-XQWpgLf6DhPHVjT-drm-aes.ism/9378-XQWpgLf6DhPHVjT-drm-aes-audio=320000-video=4933000.m3u8'
[download] Andris Nelsons conducts Sibelius and Shostakovich — With Anne-Sophie Mutter-m.mp4 has already been downloaded
[download] 100% of 204.47MiB
[debug] ffmpeg command line: ffprobe -show_streams "file:Andris Nelsons conducts Sibelius and Shostakovich — With Anne-Sophie Mutter-m.mp4"

C:\WINDOWS\system32>

Description

WRITE DESCRIPTION HERE The concert I try to download has a size of 3 - 5 GB and is 1 hour and 45 minutes long. The download however has a size of 204.47 MiB, which is about 2 minutes long. Interestingly, the part which is downloaded does not represent the beginning of the concert, but only when Anne-Sophie Mutter is in the middle of playing her Stradivarius. It is saved with the extension mp4.part.

I have a valid and current one-year subscription on www.medici.tv. I also attempted to use in the command line my Username and Password, youtube-dl --hls-prefer-native -u USERNAME -p PASSWORD, but to no avail. Please note that I used my proper Username and proper Password, which I don't want to share on any public forum. I trust you understand.

I add to this, that I initally started to download with the command line: youtube-dl https://www.medici.tv/en/concerts/sibelius-anne-sophie-mutter-andris-nelsons-orchestre-royal-du-concertgebouw, but that returned a lot of hls errors and no download at all. That is when I added the switch in the command line "--hold-prefer-native".

medici.tv is the only site which doesn't work for me. ARTE.TV and YouTube.com work like a charm. The extractor medici, as I read in the ChangeLog dates back to 2017. So, may be medici.tv changed something on their site?

Please don't hesitate to contact me if you have any questions.

Kind regards, switch6332

october262 commented 3 years ago

noticed this word drm in your link - https://sdn-global-streaming-cache.3qsdn.com/9378/files/20/11/2220797/9378-XQWpgLf6DhPHVjT-drm-aes.ism/9378-XQWpgLf6DhPHVjT-drm-aes-audio=320000-video=4933000.m3u8

do you get a popup message saying something about installing widedevine DRM ?? if yes, then it is likely that the video cannot be downloaded. youtube-dl does not support the removal of DRM protected content.

switch6343 commented 3 years ago

Thanks for your feedback. No, I did not get a popup message stating something about installing widevine DRM.

switch6343 commented 3 years ago

I just found out, that the sequence which is downloaded, is identical to the Video of this concert, when I'm NOT logged in, which is a 2.38 minutes video.

As soon as I log in as a subscriber, I am able to watch the full concert of 1 hour, 42 minutes and 47 seconds. As I informed you before, I tried to download the full concert with the -u USERNAME and -p PASSWORD switches, but that did not work. Would you like me to try that once more with the -v (Verbose) switch, so as to be able to see the communication of Y-DL in verbose? Pls advise.

switch6343 commented 3 years ago

Verbose Log

Microsoft Windows [Version 10.0.19042.630] (c) 2020 Microsoft Corporation. All rights reserved.

C:\WINDOWS\system32>youtube-dl -v --hls-prefer-native -u USERNAME -p PASSWORD https://www.medici.tv/en/concerts/sibelius-anne-sophie-mutter-andris-nelsons-orchestre-royal-du-concertgebouw/ [debug] System config: [] [debug] User config: [] [debug] Custom config: [] [debug] Command-line args: ['-v', '--hls-prefer-native', '-u', 'PRIVATE', '-p', 'PRIVATE', 'https://www.medici.tv/en/concerts/sibelius-anne-sophie-mutter-andris-nelsons-orchestre-royal-du-concertgebouw/'] [debug] Encodings: locale cp1252, fs mbcs, out cp850, pref cp1252 [debug] youtube-dl version 2020.11.26 [debug] Python version 3.4.4 (CPython) - Windows-10-10.0.19041 [debug] exe versions: ffmpeg N-100029-g040e989223, ffprobe N-100029-g040e989223 [debug] Proxy map: {} [generic] sibelius-anne-sophie-mutter-andris-nelsons-orchestre-royal-du-concertgebouw: Requesting header WARNING: Falling back on generic information extractor. [generic] sibelius-anne-sophie-mutter-andris-nelsons-orchestre-royal-du-concertgebouw: Downloading webpage [generic] sibelius-anne-sophie-mutter-andris-nelsons-orchestre-royal-du-concertgebouw: Extracting information [generic] m: Downloading m3u8 information [debug] Default format spec: bestvideo+bestaudio/best [debug] Invoking downloader on 'https://sdn-global-streaming-cache.3qsdn.com/9378/files/20/11/2220797/9378-XQWpgLf6DhPHVjT-drm-aes.ism/9378-XQWpgLf6DhPHVjT-drm-aes-audio=320000-video=4933000.m3u8' [download] Andris Nelsons conducts Sibelius and Shostakovich — With Anne-Sophie Mutter-m.mp4 has already been downloaded [download] 100% of 204.47MiB [debug] ffmpeg command line: ffprobe -show_streams "file:Andris Nelsons conducts Sibelius and Shostakovich — With Anne-Sophie Mutter-m.mp4"

C:\WINDOWS\system32>

Please note that I replaced my proper Usename and my proper Password, and highlighted these in Bold in above Verbose log.

october262 commented 3 years ago

install the firefox addon called the stream detector and see if that'll work on this video.

switch6343 commented 3 years ago

I copied the visible URLs from within the Addon Stream Detector.

When I'm NOT logged-in in www.medici.tv - 3 URLs:

https://sdn-global-streaming-cache.3qsdn.com/9378/files/20/11/2220797/9378-XQWpgLf6DhPHVjT-drm-aes.ism/9378-XQWpgLf6DhPHVjT-drm-aes-audio=320000-video=1927000.m3u8

https://sdn-global-streaming-cache.3qsdn.com/9378/files/20/11/2220797/9378-XQWpgLf6DhPHVjT-drm-aes.ism/9378-XQWpgLf6DhPHVjT-drm-aes-audio=160000-video=554000.m3u8

https://playout.prod.medicitv.fr/satie/vod/eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJ1cmwiOiJodHRwczovL3Nkbi1nbG9iYWwtc3RyZWFtaW5nLWNhY2hlLjNxc2RuLmNvbS85Mzc4L2ZpbGVzLzIwLzExLzIyMjA3OTcvOTM3OC1YUVdwZ0xmNkRoUEhWalQtZHJtLWFlcy5pc20vbWFuaWZlc3QubTN1OCIsImlhdCI6MTYwNjQ0MTc0NiwiZXhwIjoxNjA3MDQ2NTQ2fQ.ltFnB32-nN1GoLoJisjLv6GSrWEI6I9T4cd7Kv9T878/m.m3u8

The 3rd URL is inexplicable to me, because reference is made to Satie, which is a French composer of the beginning of the last century and in not way has anything to do with the concert

When I'm Logged-in in www.medici.tv - 5 URLs:

https://sdn-global-streaming-cache.3qsdn.com/9378/files/20/08/1814608/9378-Fc2BRwHyK3CZvrY-drm-aes.ism/9378-Fc2BRwHyK3CZvrY-drm-aes-audio=320000-video=1949000.m3u8

https://playout.prod.medicitv.fr/satie/vod/eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJ1cmwiOiJodHRwczovL3Nkbi1nbG9iYWwtc3RyZWFtaW5nLWNhY2hlLjNxc2RuLmNvbS85Mzc4L2ZpbGVzLzIwLzA4LzE4MTQ2MDgvOTM3OC1GYzJCUndIeUszQ1p2clktZHJtLWFlcy5pc20vbWFuaWZlc3QubTN1OCIsImlhdCI6MTYwNjQ0MjMxNiwiZXhwIjoxNjA3MDQ3MTE2fQ.RHDxMvF1s1Z_O32MyzL4_mLo4D3kezKdHhla6I_hC7k/m.m3u8

https://sdn-global-streaming-cache.3qsdn.com/9378/files/20/11/2220797/9378-XQWpgLf6DhPHVjT-drm-aes.ism/9378-XQWpgLf6DhPHVjT-drm-aes-audio=320000-video=1927000.m3u8

https://sdn-global-streaming-cache.3qsdn.com/9378/files/20/11/2220797/9378-XQWpgLf6DhPHVjT-drm-aes.ism/9378-XQWpgLf6DhPHVjT-drm-aes-audio=160000-video=554000.m3u8

https://playout.prod.medicitv.fr/satie/vod/eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJ1cmwiOiJodHRwczovL3Nkbi1nbG9iYWwtc3RyZWFtaW5nLWNhY2hlLjNxc2RuLmNvbS85Mzc4L2ZpbGVzLzIwLzExLzIyMjA3OTcvOTM3OC1YUVdwZ0xmNkRoUEhWalQtZHJtLWFlcy5pc20vbWFuaWZlc3QubTN1OCIsImlhdCI6MTYwNjQ0MTc0NiwiZXhwIjoxNjA3MDQ2NTQ2fQ.ltFnB32-nN1GoLoJisjLv6GSrWEI6I9T4cd7Kv9T878/m.m3u8

Again, two URLs refer to Eric Satie, the French composer, for no reason.

switch6343 commented 3 years ago

Please note that I can see the full concert when I'm logged in, which is a 1 hour and 43 minutes live concert with excellent video.

When I'm NOT logged in, the "concert" lasts only 2 minutes 38 seconds.

switch6343 commented 3 years ago

The latter, in my previous posting, applies to when I watch the concert in Firefox, with the addon Stream Detector installed. However in both cases Y-DL downloads the 2 minutes 38 seconds "concert" only. It appears that logging-in during Y-DL into www.medici.tv is successful.

I add to this, that I'm not able to watch this concert on my Android Smart TV (with built-in Google Chromecast), because Google Play store does not offer a medici.tv App. But Google Play store does offer an Arte.tv app. It would be possible to watch the concert using the Webbrowser built-in the Android Smart TV, but that is a very and cumbersome process.

What I do is to (Google) Chromecast the concerts from my PC to my Android TV, using BubbleUPnP Server installed on my PC and JRiver Media Center. Archived concerts in my library on my PC I chromecast to my Adroid TV.

switch6343 commented 3 years ago

I have noticed, that during the download a warning message appears:. See the verbose download logs. "WARNING: Falling back on generic information extractor".

Does this mean that the specific medici extractor does not work (anymore)? And if so, what could be the culprit?

october262 commented 3 years ago

try this, play the concert video and press F12 on your keyboard select NETWORK and then XHR , you should see a file called m.m3u8 (may have to refresh the page for it to show) copy the URL / LINK and then paste it into youtube-dl . TESTED, does work on the sample 2:38 video

switch6343 commented 3 years ago

october262, so far not luck. I didn't find a m.m3u8 file, yet. But hang on, pls give me some more time to find out. I will expectedly be back sometime tomorrow. Need to dig into this further first. I am greatful to you and for your patience and efforts in helping me to find a solution. Stay tuned.

switch6343 commented 3 years ago

Another problem. I am able to download the concert in mp4, but I can't find to where the downloaded file is saved to. It used to save by default in C: \Program Files\Youtube DL\ (this is the path where youtube-dl.exe is stored). Explorer search didn't give me a positive hit/return. I once more restarted the indexing process in Windows 10, but to no avail as well.

I looked for a switch in Man Pages which would allow me to send the MP4 file to a specified folder, but I could not find such switch. Could you please advise how I can achieve that, october262?

october262 commented 3 years ago

Another problem. I am able to download the concert in mp4, but I can't find to where the downloaded file is saved to. It used to save by default in C: \Program Files\Youtube DL\ (this is the path where youtube-dl.exe is stored). Explorer search didn't give me a positive hit/return. I once more restarted the indexing process in Windows 10, but to no avail as well.

I looked for a switch in Man Pages which would allow me to send the MP4 file to a specified folder, but I could not find such switch. Could you please advise how I can achieve that, october262?

try redownloading the file again, it should say where the file is saved On Windows, the user wide configuration file locations are %APPDATA%\youtube-dl\config. txt or C:\Users\\youtube-dl.

switch6343 commented 3 years ago

OK, I got lost. So, I decided to use Youtube-DLG (a GUI version), which as I understand is not maintained since 2017 anymore. This is what I did:

  1. I logged-in in www.medici.tv
  2. searched under Concerts for "Andris Nelsons conducts Sibelius and Shostakovich — With Anne-Sophie Mutter"
  3. Started playing this concert 4 clicked on the Firefox addon The Stream Detector and copied the m3u8 file with the longest file name (so, not m.m3u8), which looks like this: "https://sdn-global-streaming-cache.........m3u8)
  4. I started Youtube-DLG, pasted the long file name and added it for download and I pressed the Download button.
  5. The mp4 file, with a size of 1.7 GB, was saved to the folder I had defined/set in Y-DLG.
  6. I had to change the (long) file name of the mp4 file to "Andris Nelsons conducts Sibelius and Shostakovich — With Anne-Sophie Mutter.mp4".

I opened my Media Center et voilà, I could (have) watch(ed) the concert in Full length.

Do you possibly know which switches are used/configured/set in Youtube-DLG? I'd like to know, because it would allow me to keep up-to-date with the original Youtube-DL command line but using de Y-DLG switches which are (for me) hidden under the hood of Youtube-DLG.

switch6343 commented 3 years ago

I saw in a verbose download attempt from the medici.tv site, a reference toe ffprobe (one of the three executables in the ffmpeg "suite"). Instead of using the information from The Stream Detector, would it be possible to include e.g. -ffprobe (or similar) as a switch in the command line of y-dl, to invoke ffprobe? As I understand, ffprobe is also a multimedia stream analyzer. Maybe ffprobe is used and hidden under the hood of Y-DLG? What is your opinion, october262?

switch6343 commented 3 years ago

I think I found all of the switches/options for the configuration of Y-Dl, used in Y-DLG: Default switches:

-i or --ignore-errors --ignore-config --hls-prefer-native

Save all videos under Movies directory in your home directory

-o ~/Movies/%(title)s.%(ext)s

When I initially attemtped to download a video from medici.tv in the command line without any switches, reference was made that ffmpeg was missing. SO, I guess under the hood of Y-DL could be hidden the following switch:

--ffmpeg-location PATH

october272, have I forgotten any?

In any case, a download has first to be made, logged-in in medici.tv, in verbose, to catch the correct URL in the form of "https://sdn-global-streaming-cache.........m3u8".

In Y-DLG one can update youtube-dl.exe to the latest version. I cannot check if that really is the case. What is your opinion?

Thanks for all your efforts and advise. No doubt, without your expert feedback I would never have come to where I am now. A great many thanks. Keep on keeping up. You're the best.

switch6343 commented 3 years ago

Sorry, that line "Save all videos under Movies directory in your home directory" was unintentional. I did not want to scream.

switch6343 commented 3 years ago

Just for your information: I checked if Y-DLG downloads the latest Y-DL version when one selects Update under Settings. I can confirm that it does download the latest youtube-dl version.