search

ytdl-org / youtube-dl

Command-line program to download videos from YouTube.com and other video sites
http://ytdl-org.github.io/youtube-dl/
The Unlicense
131.43k stars 9.96k forks source link

Vimeo Pro - 1920 Pixel Video not downloadable :-( #31366

Closed piknockyou closed 1 year ago

piknockyou commented 1 year ago

Checklist

Verbose log

youtube-dl -v https://11vod-adaptive.akamaized.net/exp=1668900760~acl=%2F92554567-2f1f-4673-8169-5f7c39af9df2%2F%2A~hmac=a78f89f321cb5ab802b5e262bf1a7b8f996988ff8df88aa8b9cc03aa6c6d6b53/92554567-2f1f-4673-8169-5f7c39af9df2/parcel/video/ba502be5.mp4
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-v', 'https://11vod-adaptive.akamaized.net/exp=1668900760~acl=%2F92554567-2f1f-4673-8169-5f7c39af9df2%2F%2A~hmac=a78f89f321cb5ab802b5e262bf1a7b8f996988ff8df88aa8b9cc03aa6c6d6b53/92554567-2f1f-4673-8169-5f7c39af9df2/parcel/video/ba502be5.mp4']
[debug] Encodings: locale cp1252, fs mbcs, out cp850, pref cp1252
[debug] youtube-dl version 2021.12.17
[debug] Python version 3.4.4 (CPython) - Windows-10-10.0.22621
[debug] exe versions: ffmpeg 2022-11-03-git-5ccd4d3060-full_build-www.gyan.dev, ffprobe 2022-11-03-git-5ccd4d3060-full_build-www.gyan.dev
[debug] Proxy map: {}
[generic] ba502be5: Requesting header
[debug] Default format spec: bestvideo+bestaudio/best
[debug] Invoking downloader on 'https://11vod-adaptive.akamaized.net/exp=1668900760~acl=%2F92554567-2f1f-4673-8169-5f7c39af9df2%2F%2A~hmac=a78f89f321cb5ab802b5e262bf1a7b8f996988ff8df88aa8b9cc03aa6c6d6b53/92554567-2f1f-4673-8169-5f7c39af9df2/parcel/video/ba502be5.mp4'
ERROR: unable to download video data: HTTP Error 403: Forbidden
Traceback (most recent call last):
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpupik7c6w\build\youtube_dl\YoutubeDL.py", line 1976, in process_info
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpupik7c6w\build\youtube_dl\YoutubeDL.py", line 1915, in dl
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpupik7c6w\build\youtube_dl\downloader\common.py", line 366, in download
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpupik7c6w\build\youtube_dl\downloader\http.py", line 351, in real_download
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpupik7c6w\build\youtube_dl\downloader\http.py", line 116, in establish_connection
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpupik7c6w\build\youtube_dl\downloader\http.py", line 110, in establish_connection
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpupik7c6w\build\youtube_dl\YoutubeDL.py", line 2288, in urlopen
  File "C:\Python\Python34\lib\urllib\request.py", line 470, in open
  File "C:\Python\Python34\lib\urllib\request.py", line 580, in http_response
  File "C:\Python\Python34\lib\urllib\request.py", line 508, in error
  File "C:\Python\Python34\lib\urllib\request.py", line 442, in _call_chain
  File "C:\Python\Python34\lib\urllib\request.py", line 588, in http_error_default
urllib.error.HTTPError: HTTP Error 403: Forbidden

Description

Hello,

Site: https://vimeopro.com/cadfem/simulation-conference-mechanische-systeme-in-perfektion Password: Conference2022

"Original Media Link": https://11vod-adaptive.akamaized.net/exp=1668900760~acl=%2F92554567-2f1f-4673-8169-5f7c39af9df2%2F%2A~hmac=a78f89f321cb5ab802b5e262bf1a7b8f996988ff8df88aa8b9cc03aa6c6d6b53/92554567-2f1f-4673-8169-5f7c39af9df2/sep/video/e22e0b59,d3d2c0c8,7acab0de,ba502be5,0f745f59/audio/7cc595f1,8de9c6ad,a22024ff/master.json?query_string_ranges=1&base64_init=1

I was able to "decipher" what is what. So the "base" would be: https://11vod-adaptive.akamaized.net/exp=1668900760~acl=%2F92554567-2f1f-4673-8169-5f7c39af9df2%2F%2A~hmac=a78f89f321cb5ab802b5e262bf1a7b8f996988ff8df88aa8b9cc03aa6c6d6b53/92554567-2f1f-4673-8169-5f7c39af9df2/parcel/

and following extensions apply:

AUDIO audio/a22024ff.mp4 63,6 kb/s audio/8de9c6ad.mp4 95,1 kb/s audio/7cc595f1.mp4 192 kb/s

VIDEO video/e22e0b59.mp4 960 Pixel video/d3d2c0c8.mp4 426 Pixel video/7acab0de.mp4 640 Pixel video/ba502be5.mp4 NOT WORKING video/0f745f59.mp4 1280 Pixel

My problem is "video/ba502be5.mp4", which would certainly be the 1920 Pixel Video. How can I get it?

Thank you & best wishes! : )

dirkf commented 1 year ago

What happens if you pass browser cookies from a session where you can play the 1920 format?

Your media link is presumably time-limited.

See #20070.

dirkf commented 1 year ago

Also, try https://vimeo.com/764543723/f4a7f509ff?h=f4a7f509ff.

piknockyou commented 1 year ago

What happens if you pass browser cookies from a session where you can play the 1920 format? Yes.

Also, try https://vimeo.com/764543723/f4a7f509ff?h=f4a7f509ff.

Please elaborate how you have gotten this link. : ) You've got https://player.vimeo.com/video/764543723?h=f4a7f509ff&portfolio_id=1612641 from the console and re-wrote it from experience?

dirkf commented 1 year ago

It's in the source of the page that you get after entering the password.

piknockyou commented 1 year ago

You've got https://player.vimeo.com/video/764543723?h=f4a7f509ff&portfolio_id=1612641 from the console and re-wrote it from experience?

dirkf commented 1 year ago

Anyhow, this is the 'book' solution. Find the cookie set for .vimeopro.com after entering the password in the original page. For me it was like this:

portfolio_1612641=67bceb086300baed20fd830acaf7bf88a6b1ac32f5ad1480f296df8956514f26.1669578724

You can either pull this out of the browser devtools or cookie manager and pass a suitable Cookie: header, or export a cookies.txt and pass --cookies cookies.txt. I went the first way:

$ python -m youtube_dl -v -F --add-header 'Cookie: portfolio_1612641=67bceb086300baed20fd830acaf7bf88a6b1ac32f5ad1480f296df8956514f26.1669578724' 'https://vimeopro.com/cadfem/simulation-conference-mechanische-systeme-in-perfektion'
[debug] System config: [u'--prefer-ffmpeg']
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'-v', u'-F', u'--add-header', u'Cookie: portfolio_1612641=67bceb086300baed20fd830acaf7bf88a6b1ac32f5ad1480f296df8956514f26.1669578724', u'https://vimeopro.com/cadfem/simulation-conference-mechanische-systeme-in-perfektion']
[debug] Adding header from command line option Cookie: portfolio_1612641=67bceb086300baed20fd830acaf7bf88a6b1ac32f5ad1480f296df8956514f26.1669578724
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2021.12.17
[debug] Git HEAD: 774b346f9
[debug] Python version 2.7.17 (CPython) - Linux-4.4.0-210-generic-i686-with-Ubuntu-16.04-xenial
[debug] exe versions: avconv 4.3, avprobe 4.3, ffmpeg 4.3, ffprobe 4.3
[debug] Proxy map: {}
[generic] simulation-conference-mechanische-systeme-in-perfektion: Requesting header
WARNING: Falling back on generic information extractor.
[generic] simulation-conference-mechanische-systeme-in-perfektion: Downloading webpage
[generic] simulation-conference-mechanische-systeme-in-perfektion: Extracting information
[download] Downloading playlist: Mechanische Systeme in Perfektion - Mechanische Systeme in Perfektion: Realität erfassen, Innovation treiben
[generic] playlist Mechanische Systeme in Perfektion - Mechanische Systeme in Perfektion: Realität erfassen, Innovation treiben: Collected 1 video ids (downloading 1 of them)
[download] Downloading video 1 of 1
[vimeo] 764543723: Downloading webpage
[vimeo] 764543723: Downloading akfire_interconnect_quic m3u8 information
[vimeo] 764543723: Downloading akfire_interconnect_quic m3u8 information
[vimeo] 764543723: Downloading fastly_skyfire m3u8 information
[vimeo] 764543723: Downloading fastly_skyfire m3u8 information
[vimeo] 764543723: Downloading akfire_interconnect_quic MPD information
[vimeo] 764543723: Downloading akfire_interconnect_quic MPD information
[vimeo] 764543723: Downloading fastly_skyfire MPD information
[vimeo] 764543723: Downloading fastly_skyfire MPD information
[info] Available formats for 764543723:
format code                                        extension  resolution note
hls-akfire_interconnect_quic_sep-audio-high-audio  mp4        audio only 
hls-fastly_skyfire_sep-audio-high-audio            mp4        audio only 
dash-akfire_interconnect_quic_sep-audio-a22024ff   m4a        audio only DASH audio   66k , m4a_dash container, opus  (48000Hz)
dash-fastly_skyfire_sep-audio-a22024ff             m4a        audio only DASH audio   66k , m4a_dash container, opus  (48000Hz)
dash-akfire_interconnect_quic_sep-audio-8de9c6ad   m4a        audio only DASH audio   98k , m4a_dash container, opus  (48000Hz)
dash-fastly_skyfire_sep-audio-8de9c6ad             m4a        audio only DASH audio   98k , m4a_dash container, opus  (48000Hz)
dash-akfire_interconnect_quic_sep-audio-7cc595f1   m4a        audio only DASH audio  191k , m4a_dash container, mp4a.40.2 (48000Hz)
dash-fastly_skyfire_sep-audio-7cc595f1             m4a        audio only DASH audio  191k , m4a_dash container, mp4a.40.2 (48000Hz)
hls-akfire_interconnect_quic-114                   mp4        426x240     114k , avc1.640015, 25.0fps, video only
hls-fastly_skyfire-114                             mp4        426x240     114k , avc1.640015, 25.0fps, video only
hls-akfire_interconnect_quic_sep-305               mp4        426x240     305k , avc1.640015, 25.0fps, video only
hls-fastly_skyfire_sep-305                         mp4        426x240     305k , avc1.640015, 25.0fps, video only
dash-akfire_interconnect_quic-video-d3d2c0c8       mp4        426x240    DASH video  310k , mp4_dash container, avc1.640015, 25fps, video only
dash-akfire_interconnect_quic_sep-video-d3d2c0c8   mp4        426x240    DASH video  310k , mp4_dash container, avc1.640015, 25fps, video only
dash-fastly_skyfire-video-d3d2c0c8                 mp4        426x240    DASH video  310k , mp4_dash container, avc1.640015, 25fps, video only
dash-fastly_skyfire_sep-video-d3d2c0c8             mp4        426x240    DASH video  310k , mp4_dash container, avc1.640015, 25fps, video only
hls-akfire_interconnect_quic-225                   mp4        640x360     225k , avc1.64001E, 25.0fps, video only
hls-fastly_skyfire-225                             mp4        640x360     225k , avc1.64001E, 25.0fps, video only
hls-akfire_interconnect_quic_sep-416               mp4        640x360     416k , avc1.64001E, 25.0fps, video only
hls-fastly_skyfire_sep-416                         mp4        640x360     416k , avc1.64001E, 25.0fps, video only
dash-akfire_interconnect_quic-video-7acab0de       mp4        640x360    DASH video  611k , mp4_dash container, avc1.64001E, 25fps, video only
dash-akfire_interconnect_quic_sep-video-7acab0de   mp4        640x360    DASH video  611k , mp4_dash container, avc1.64001E, 25fps, video only
dash-fastly_skyfire-video-7acab0de                 mp4        640x360    DASH video  611k , mp4_dash container, avc1.64001E, 25fps, video only
dash-fastly_skyfire_sep-video-7acab0de             mp4        640x360    DASH video  611k , mp4_dash container, avc1.64001E, 25fps, video only
hls-akfire_interconnect_quic-464                   mp4        960x540     464k , avc1.64001F, 25.0fps, video only
hls-fastly_skyfire-464                             mp4        960x540     464k , avc1.64001F, 25.0fps, video only
hls-akfire_interconnect_quic_sep-655               mp4        960x540     655k , avc1.64001F, 25.0fps, video only
hls-fastly_skyfire_sep-655                         mp4        960x540     655k , avc1.64001F, 25.0fps, video only
dash-akfire_interconnect_quic-video-e22e0b59       mp4        960x540    DASH video 1149k , mp4_dash container, avc1.64001F, 25fps, video only
dash-akfire_interconnect_quic_sep-video-e22e0b59   mp4        960x540    DASH video 1149k , mp4_dash container, avc1.64001F, 25fps, video only
dash-fastly_skyfire-video-e22e0b59                 mp4        960x540    DASH video 1149k , mp4_dash container, avc1.64001F, 25fps, video only
dash-fastly_skyfire_sep-video-e22e0b59             mp4        960x540    DASH video 1149k , mp4_dash container, avc1.64001F, 25fps, video only
hls-akfire_interconnect_quic-726                   mp4        1280x720    726k , avc1.640020, 25.0fps, video only
hls-fastly_skyfire-726                             mp4        1280x720    726k , avc1.640020, 25.0fps, video only
hls-akfire_interconnect_quic_sep-917               mp4        1280x720    917k , avc1.640020, 25.0fps, video only
hls-fastly_skyfire_sep-917                         mp4        1280x720    917k , avc1.640020, 25.0fps, video only
dash-akfire_interconnect_quic-video-0f745f59       mp4        1280x720   DASH video 1837k , mp4_dash container, avc1.640020, 25fps, video only
dash-akfire_interconnect_quic_sep-video-0f745f59   mp4        1280x720   DASH video 1837k , mp4_dash container, avc1.640020, 25fps, video only
dash-fastly_skyfire-video-0f745f59                 mp4        1280x720   DASH video 1837k , mp4_dash container, avc1.640020, 25fps, video only
dash-fastly_skyfire_sep-video-0f745f59             mp4        1280x720   DASH video 1837k , mp4_dash container, avc1.640020, 25fps, video only
hls-akfire_interconnect_quic-1390                  mp4        1920x1080  1390k , avc1.64002A, 25.0fps, video only
hls-fastly_skyfire-1390                            mp4        1920x1080  1390k , avc1.64002A, 25.0fps, video only
hls-akfire_interconnect_quic_sep-1581              mp4        1920x1080  1581k , avc1.64002A, 25.0fps, video only
hls-fastly_skyfire_sep-1581                        mp4        1920x1080  1581k , avc1.64002A, 25.0fps, video only
dash-akfire_interconnect_quic-video-ba502be5       mp4        1920x1080  DASH video 3649k , mp4_dash container, avc1.64002A, 25fps, video only
dash-akfire_interconnect_quic_sep-video-ba502be5   mp4        1920x1080  DASH video 3649k , mp4_dash container, avc1.64002A, 25fps, video only
dash-fastly_skyfire-video-ba502be5                 mp4        1920x1080  DASH video 3649k , mp4_dash container, avc1.64002A, 25fps, video only
dash-fastly_skyfire_sep-video-ba502be5             mp4        1920x1080  DASH video 3649k , mp4_dash container, avc1.64002A, 25fps, video only (best)
[download] Finished downloading playlist: Mechanische Systeme in Perfektion - Mechanische Systeme in Perfektion: Realität erfassen, Innovation treiben
$
Vangelis66 commented 1 year ago

... A similar method that doesn't involve cookies 😉 ; via URL sniffing (browser's Web Console), it is found that the video is actually hosted on vimeo at: 

https://player.vimeo.com/video/764543723?h=f4a7f509ff&portfolio_id=1612641

; then, the embedding page has to be passed on as referer: 

youtube-dl --referer "https://vimeopro.com/cadfem/simulation-conference-mechanische-systeme-in-perfektion" -vF "https://player.vimeo.com/video/764543723?h=f4a7f509ff&portfolio_id=1612641" => 

[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['--referer', 'https://vimeopro.com/cadfem/simulation-conference-mechanische-systeme-in-perfektion', '-vF', 'https://player.vimeo.com/video/764543723?h=f4a7f509ff&portfolio_id=1612641']
[debug] Encodings: locale cp1253, fs mbcs, out cp737, pref cp1253
[debug] youtube-dl version 2022.11.27.114514
[debug] Python version 3.4.4 (CPython) - Windows-Vista-6.0.6003-SP2
[debug] exe versions: ffmpeg 5.0, ffprobe 5.0, phantomjs 2.1.1, rtmpdump 2.4
[debug] Proxy map: {}
[vimeo] 764543723: Downloading webpage
[vimeo] 764543723: Downloading akfire_interconnect_quic m3u8 information
[vimeo] 764543723: Downloading akfire_interconnect_quic m3u8 information
[vimeo] 764543723: Downloading fastly_skyfire m3u8 information
[vimeo] 764543723: Downloading fastly_skyfire m3u8 information
[vimeo] 764543723: Downloading akfire_interconnect_quic MPD information
[vimeo] 764543723: Downloading akfire_interconnect_quic MPD information
[vimeo] 764543723: Downloading fastly_skyfire MPD information
[vimeo] 764543723: Downloading fastly_skyfire MPD information
[info] Available formats for 764543723:
format code                                        extension  resolution note
hls-akfire_interconnect_quic_sep-audio-high-audio  mp4        audio only
hls-fastly_skyfire_sep-audio-high-audio            mp4        audio only
dash-akfire_interconnect_quic_sep-audio-a22024ff   m4a        audio only DASH audio   66k , m4a_dash container, opus  (48000Hz)
dash-fastly_skyfire_sep-audio-a22024ff             m4a        audio only DASH audio   66k , m4a_dash container, opus  (48000Hz)
dash-akfire_interconnect_quic_sep-audio-8de9c6ad   m4a        audio only DASH audio   98k , m4a_dash container, opus  (48000Hz)
dash-fastly_skyfire_sep-audio-8de9c6ad             m4a        audio only DASH audio   98k , m4a_dash container, opus  (48000Hz)
dash-akfire_interconnect_quic_sep-audio-7cc595f1   m4a        audio only DASH audio  191k , m4a_dash container, mp4a.40.2 (48000Hz)
dash-fastly_skyfire_sep-audio-7cc595f1             m4a        audio only DASH audio  191k , m4a_dash container, mp4a.40.2 (48000Hz)
hls-akfire_interconnect_quic-114                   mp4        426x240     114k , avc1.640015, 25.0fps, video only
hls-fastly_skyfire-114                             mp4        426x240     114k , avc1.640015, 25.0fps, video only
hls-akfire_interconnect_quic_sep-305               mp4        426x240     305k , avc1.640015, 25.0fps, video only
hls-fastly_skyfire_sep-305                         mp4        426x240     305k , avc1.640015, 25.0fps, video only
dash-akfire_interconnect_quic-video-d3d2c0c8       mp4        426x240    DASH video  310k , mp4_dash container, avc1.640015, 25fps, video only
dash-akfire_interconnect_quic_sep-video-d3d2c0c8   mp4        426x240    DASH video  310k , mp4_dash container, avc1.640015, 25fps, video only
dash-fastly_skyfire-video-d3d2c0c8                 mp4        426x240    DASH video  310k , mp4_dash container, avc1.640015, 25fps, video only
dash-fastly_skyfire_sep-video-d3d2c0c8             mp4        426x240    DASH video  310k , mp4_dash container, avc1.640015, 25fps, video only
hls-akfire_interconnect_quic-225                   mp4        640x360     225k , avc1.64001E, 25.0fps, video only
hls-fastly_skyfire-225                             mp4        640x360     225k , avc1.64001E, 25.0fps, video only
hls-akfire_interconnect_quic_sep-416               mp4        640x360     416k , avc1.64001E, 25.0fps, video only
hls-fastly_skyfire_sep-416                         mp4        640x360     416k , avc1.64001E, 25.0fps, video only
dash-akfire_interconnect_quic-video-7acab0de       mp4        640x360    DASH video  611k , mp4_dash container, avc1.64001E, 25fps, video only
dash-akfire_interconnect_quic_sep-video-7acab0de   mp4        640x360    DASH video  611k , mp4_dash container, avc1.64001E, 25fps, video only
dash-fastly_skyfire-video-7acab0de                 mp4        640x360    DASH video  611k , mp4_dash container, avc1.64001E, 25fps, video only
dash-fastly_skyfire_sep-video-7acab0de             mp4        640x360    DASH video  611k , mp4_dash container, avc1.64001E, 25fps, video only
hls-akfire_interconnect_quic-464                   mp4        960x540     464k , avc1.64001F, 25.0fps, video only
hls-fastly_skyfire-464                             mp4        960x540     464k , avc1.64001F, 25.0fps, video only
hls-akfire_interconnect_quic_sep-655               mp4        960x540     655k , avc1.64001F, 25.0fps, video only
hls-fastly_skyfire_sep-655                         mp4        960x540     655k , avc1.64001F, 25.0fps, video only
dash-akfire_interconnect_quic-video-e22e0b59       mp4        960x540    DASH video 1149k , mp4_dash container, avc1.64001F, 25fps, video only
dash-akfire_interconnect_quic_sep-video-e22e0b59   mp4        960x540    DASH video 1149k , mp4_dash container, avc1.64001F, 25fps, video only
dash-fastly_skyfire-video-e22e0b59                 mp4        960x540    DASH video 1149k , mp4_dash container, avc1.64001F, 25fps, video only
dash-fastly_skyfire_sep-video-e22e0b59             mp4        960x540    DASH video 1149k , mp4_dash container, avc1.64001F, 25fps, video only
hls-akfire_interconnect_quic-726                   mp4        1280x720    726k , avc1.640020, 25.0fps, video only
hls-fastly_skyfire-726                             mp4        1280x720    726k , avc1.640020, 25.0fps, video only
hls-akfire_interconnect_quic_sep-917               mp4        1280x720    917k , avc1.640020, 25.0fps, video only
hls-fastly_skyfire_sep-917                         mp4        1280x720    917k , avc1.640020, 25.0fps, video only
dash-akfire_interconnect_quic-video-0f745f59       mp4        1280x720   DASH video 1837k , mp4_dash container, avc1.640020, 25fps, video only
dash-akfire_interconnect_quic_sep-video-0f745f59   mp4        1280x720   DASH video 1837k , mp4_dash container, avc1.640020, 25fps, video only
dash-fastly_skyfire-video-0f745f59                 mp4        1280x720   DASH video 1837k , mp4_dash container, avc1.640020, 25fps, video only
dash-fastly_skyfire_sep-video-0f745f59             mp4        1280x720   DASH video 1837k , mp4_dash container, avc1.640020, 25fps, video only
hls-akfire_interconnect_quic-1390                  mp4        1920x1080  1390k , avc1.64002A, 25.0fps, video only
hls-fastly_skyfire-1390                            mp4        1920x1080  1390k , avc1.64002A, 25.0fps, video only
hls-akfire_interconnect_quic_sep-1581              mp4        1920x1080  1581k , avc1.64002A, 25.0fps, video only
hls-fastly_skyfire_sep-1581                        mp4        1920x1080  1581k , avc1.64002A, 25.0fps, video only
dash-akfire_interconnect_quic-video-ba502be5       mp4        1920x1080  DASH video 3649k , mp4_dash container, avc1.64002A, 25fps, video only
dash-akfire_interconnect_quic_sep-video-ba502be5   mp4        1920x1080  DASH video 3649k , mp4_dash container, avc1.64002A, 25fps, video only
dash-fastly_skyfire-video-ba502be5                 mp4        1920x1080  DASH video 3649k , mp4_dash container, avc1.64002A, 25fps, video only
dash-fastly_skyfire_sep-video-ba502be5             mp4        1920x1080  DASH video 3649k , mp4_dash container, avc1.64002A, 25fps, video only (best)
dirkf commented 1 year ago

Rather than deploying devtools (admittedly needed for my cookie solution), looking at View Source of the page delivered after entering the password gives you a better target for yt-dl.

Vangelis66 commented 1 year ago

looking at View Source of the page delivered after entering the password gives you a better target for yt-dl.

Yep, that works too, :wink: ... I understand different people have different workflows; most (like you) tend to hunt inside Page Source; I only go there when Web Console/Network Tab of DevTools do not immediately divulge what I'm after... As long as the "job" is done...

FWIW, the vimeo URI has been unlocked quite recently (mere hours ago...), because now https://vimeo.com/764543723/f4a7f509ff even loads in a browser tab, whereas before (when I posted my previous comment) it would nag that "Sorry - Because of its privacy settings, this video cannot be played here."; the result being the --referer option is not needed anymore: 

youtube-dl -F "https://vimeo.com/764543723/f4a7f509ff" => 

[vimeo] 764543723: Downloading JSON metadata
[vimeo] 764543723: Downloading JSON metadata
[vimeo] 764543723: Downloading JSON metadata
[vimeo] 764543723: Downloading akfire_interconnect_quic m3u8 information
[vimeo] 764543723: Downloading akfire_interconnect_quic m3u8 information
[vimeo] 764543723: Downloading fastly_skyfire m3u8 information
[vimeo] 764543723: Downloading fastly_skyfire m3u8 information
[vimeo] 764543723: Downloading akfire_interconnect_quic MPD information
[vimeo] 764543723: Downloading akfire_interconnect_quic MPD information
[vimeo] 764543723: Downloading fastly_skyfire MPD information
[vimeo] 764543723: Downloading fastly_skyfire MPD information
[info] Available formats for 764543723:
format code                                        extension  resolution note
......
hls-akfire_interconnect_quic-1390                  mp4        1920x1080  1390k , avc1.64002A, 25.0fps, video only
hls-fastly_skyfire-1390                            mp4        1920x1080  1390k , avc1.64002A, 25.0fps, video only
hls-akfire_interconnect_quic_sep-1581              mp4        1920x1080  1581k , avc1.64002A, 25.0fps, video only
hls-fastly_skyfire_sep-1581                        mp4        1920x1080  1581k , avc1.64002A, 25.0fps, video only
dash-akfire_interconnect_quic-video-ba502be5       mp4        1920x1080  DASH video 3649k , mp4_dash container, avc1.64002A, 25fps, video only
dash-akfire_interconnect_quic_sep-video-ba502be5   mp4        1920x1080  DASH video 3649k , mp4_dash container, avc1.64002A, 25fps, video only
dash-fastly_skyfire-video-ba502be5                 mp4        1920x1080  DASH video 3649k , mp4_dash container, avc1.64002A, 25fps, video only
dash-fastly_skyfire_sep-video-ba502be5             mp4        1920x1080  DASH video 3649k , mp4_dash container, avc1.64002A, 25fps, video only (best)
piknockyou commented 1 year ago

@Vangelis66 As far as I know, it has not been "unlocked just recently". It is accessible since @dirkf posted in his second post 8 days ago: https://vimeo.com/764543723/f4a7f509ff?h=f4a7f509ff This is the same link as: https://vimeo.com/764543723/f4a7f509ff Vimeo only nags "the video couldn't be shown due to security settings", if you use the original link from the console: https://player.vimeo.com/video/764543723?h=f4a7f509ff&portfolio_id=1612641 But you would just need to re-write it, to get full access to the video. That's why I asked @dirkf how he has gotten the "proper" link in the first place: https://vimeo.com/764543723/f4a7f509ff?h=f4a7f509ff But I did not receive a satisfying answer. ^^

@dirkf you just answered "It's in the source of the page that you get after entering the password." But I could not find this "proper" link there https://vimeo.com/764543723/f4a7f509ff?h=f4a7f509ff Only this link is present, isn't it?: https://player.vimeo.com/video/764543723?h=f4a7f509ff&portfolio_id=1612641

So I would like to ask the same question again: Please elaborate how you have gotten this link. : ) You've got https://player.vimeo.com/video/764543723?h=f4a7f509ff&portfolio_id=1612641 from the console and re-wrote it from experience?

I believe the code has to be extended to get the proper link by its own, if applicable. Cookies or --referrer are not necessary in this case.

dirkf commented 1 year ago
  1. Navigate to problem URL, with JS disabled.
  2. Enter password and submit.
  3. In the resulting page use View Source
  4. Find the link https://vimeo.com/764543723/f4a7f509ff?h=f4a7f509ff.

However https://github.com/ytdl-org/youtube-dl/issues/31366#issuecomment-1328328495 shows the "correct" way to extract the page's video.

Vangelis66 commented 1 year ago

Vangelis66

As far as I know, it has not been "unlocked just recently". It is accessible since dirkf posted (the link below) in his second post, 8 days ago: https://vimeo.com/764543723/f4a7f509ff?h=f4a7f509ff

This is the same link as: https://vimeo.com/764543723/f4a7f509ff

Vimeo only nags "Sorry - Because of its privacy settings, this video cannot be played here.", if you use the original link from the console: https://player.vimeo.com/video/764543723?h=f4a7f509ff&portfolio_id=1612641

You are right (at least as things stand now) 😄 ; I won't pretend I have vivid recollection of all the tests I made then 😉 , it was late night/early morning in my timezone, so chances are I mixed things up 😊 ; I may have tested https://player.vimeo.com/video/764543723?h=f4a7f509ff instead of https://vimeo.com/764543723/f4a7f509ff?h=f4a7f509ff (the "dirkf" link) that night and it wouldn't download 😒 ...

I believe the code has to be extended to get the proper link by its own, if applicable. Cookies or --referrer are not necessary in this case.

IOW, you're asking for yt-dl's genericIE [and/or vimeoIE] to be equipped with a --password feature (provided by the user), so media pages behind a password (ultimately, log-in credentials) be accessible by it... Or even a new, dedicated, vimeoproIE... News bulletin: The forked project yt-dlp has already implemented that: 

yt-dlp -vF --video-password "Conference2022" "https://vimeopro.com/cadfem/simulation-conference-mechanische-systeme-in-perfektion" => 

[debug] Command-line config: ['--ffmpeg-location', '..', '--downloader-args', 'ffmpeg:-v 8 -stats', '-vF', '--video-password', 'PRIVATE', 'https://vimeopro.com/cadfem/simulation-conference-mechanische-systeme-in-perfektion']
[debug] Encodings: locale cp1253, fs utf-8, pref cp1253, out utf-8 (No VT), error utf-8 (No VT), screen utf-8 (No VT)
[debug] ytdl-patched/yt-dlp version 2022.11.27.43044 [98c5f91] (win_x86_exe)
[debug] Python 3.7.9 (CPython x86 32bit) - Windows-Vista-6.0.6003-SP2 (OpenSSL 1.1.1g  21 Apr 2020)
[debug] exe versions: ffmpeg 5.0 (fdk,setts), ffprobe 5.0, phantomjs 2.1.1, rtmpdump 2.4-102-ga3a600d-get_iplayer
[debug] Optional libraries: Cryptodome-3.16.0, brotli-1.0.9, certifi-2022.09.24, mutagen-1.46.0, sqlite3-2.6.0, websockets-10.4
[debug] Proxy map: {}
[debug] Loaded 1727 extractors
[debug] [vimeo:pro] Extracting URL: https://vimeopro.com/cadfem/simulation-conference-mechanische-systeme-in-perfektion
[vimeo:pro] simulation-conference-mechanische-systeme-in-perfektion: Downloading webpage
[vimeo:pro] simulation-conference-mechanische-systeme-in-perfektion: Logging in with video password
[debug] [vimeo] Extracting URL: https://player.vimeo.com/video/764543723?h=f4a7f509ff&portfolio_id=1612641#__youtubedl_smuggle=%7B%22http_headers%22%3A+%7B%22Referer%22%3A+%22https%3A%2F%2Fvimeopro.com%2Fcadfem%2Fsimulation-conference-mechanische-systeme-in-perfektion%22%7D%7D
[vimeo] 764543723: Downloading webpage
[vimeo] 764543723: Downloading akfire_interconnect_quic m3u8 information
[vimeo] 764543723: Downloading akfire_interconnect_quic m3u8 information
[vimeo] 764543723: Downloading fastly_skyfire m3u8 information
[vimeo] 764543723: Downloading fastly_skyfire m3u8 information
[vimeo] 764543723: Downloading akfire_interconnect_quic MPD information
[vimeo] 764543723: Downloading akfire_interconnect_quic MPD information
[vimeo] 764543723: Downloading fastly_skyfire MPD information
[vimeo] 764543723: Downloading fastly_skyfire MPD information
[debug] Sort order given by extractor: quality, res, fps, hdr:12, source
[debug] Formats sorted by: hasvid, ie_pref, quality, res, fps, hdr:12(7), source, lang, vcodec:vp9.2(10), channels, acodec, filesize, fs_approx, tbr, vbr, abr, asr, proto, vext, aext, hasaud, id
[info] Available formats for 764543723:
ID                                                EXT RESOLUTION FPS |   FILESIZE   TBR PROTO | VCODEC        VBR ACODEC      ABR ASR MORE INFO
---------------------------------------------------------------------------------------------------------------------------------------------------------
hls-akfire_interconnect_quic_sep-audio-high-audio mp4 audio only     |        m3u8  | audio only        unknown             audio
hls-fastly_skyfire_sep-audio-high-audio           mp4 audio only     |        m3u8  | audio only        unknown             audio
dash-akfire_interconnect_quic_sep-audio-7cc595f1  m4a audio only     | ~291.56MiB  191k dash  | audio only        mp4a.40.2  191k 48k DASH audio, m4a_dash
dash-fastly_skyfire_sep-audio-7cc595f1            m4a audio only     | ~291.56MiB  191k dash  | audio only        mp4a.40.2  191k 48k DASH audio, m4a_dash
dash-akfire_interconnect_quic_sep-audio-a22024ff  m4a audio only     | ~100.75MiB   66k dash  | audio only        opus        66k 48k DASH audio, m4a_dash
dash-fastly_skyfire_sep-audio-a22024ff            m4a audio only     | ~100.75MiB   66k dash  | audio only        opus        66k 48k DASH audio, m4a_dash
dash-akfire_interconnect_quic_sep-audio-8de9c6ad  m4a audio only     | ~149.60MiB   98k dash  | audio only        opus        98k 48k DASH audio, m4a_dash
dash-fastly_skyfire_sep-audio-8de9c6ad            m4a audio only     | ~149.60MiB   98k dash  | audio only        opus        98k 48k DASH audio, m4a_dash
hls-akfire_interconnect_quic-114                  mp4 426x240     25 | ~174.02MiB  114k m3u8  | avc1.640015  114k video only
hls-fastly_skyfire-114                            mp4 426x240     25 | ~174.02MiB  114k m3u8  | avc1.640015  114k video only
hls-akfire_interconnect_quic_sep-305              mp4 426x240     25 | ~465.58MiB  305k m3u8  | avc1.640015  305k video only
hls-fastly_skyfire_sep-305                        mp4 426x240     25 | ~465.58MiB  305k m3u8  | avc1.640015  305k video only
dash-akfire_interconnect_quic-video-d3d2c0c8      mp4 426x240     25 | ~473.21MiB  310k dash  | avc1.640015  310k video only          DASH video, mp4_dash
dash-akfire_interconnect_quic_sep-video-d3d2c0c8  mp4 426x240     25 | ~473.21MiB  310k dash  | avc1.640015  310k video only          DASH video, mp4_dash
dash-fastly_skyfire-video-d3d2c0c8                mp4 426x240     25 | ~473.21MiB  310k dash  | avc1.640015  310k video only          DASH video, mp4_dash
dash-fastly_skyfire_sep-video-d3d2c0c8            mp4 426x240     25 | ~473.21MiB  310k dash  | avc1.640015  310k video only          DASH video, mp4_dash
hls-akfire_interconnect_quic-225                  mp4 640x360     25 | ~343.46MiB  225k m3u8  | avc1.64001E  225k video only
hls-fastly_skyfire-225                            mp4 640x360     25 | ~343.46MiB  225k m3u8  | avc1.64001E  225k video only
hls-akfire_interconnect_quic_sep-416              mp4 640x360     25 | ~635.02MiB  416k m3u8  | avc1.64001E  416k video only
hls-fastly_skyfire_sep-416                        mp4 640x360     25 | ~635.02MiB  416k m3u8  | avc1.64001E  416k video only
dash-akfire_interconnect_quic-video-7acab0de      mp4 640x360     25 | ~932.68MiB  611k dash  | avc1.64001E  611k video only          DASH video, mp4_dash
dash-akfire_interconnect_quic_sep-video-7acab0de  mp4 640x360     25 | ~932.68MiB  611k dash  | avc1.64001E  611k video only          DASH video, mp4_dash
dash-fastly_skyfire-video-7acab0de                mp4 640x360     25 | ~932.68MiB  611k dash  | avc1.64001E  611k video only          DASH video, mp4_dash
dash-fastly_skyfire_sep-video-7acab0de            mp4 640x360     25 | ~932.68MiB  611k dash  | avc1.64001E  611k video only          DASH video, mp4_dash
hls-akfire_interconnect_quic-464                  mp4 960x540     25 | ~708.29MiB  464k m3u8  | avc1.64001F  464k video only
hls-fastly_skyfire-464                            mp4 960x540     25 | ~708.29MiB  464k m3u8  | avc1.64001F  464k video only
hls-akfire_interconnect_quic_sep-655              mp4 960x540     25 | ~999.85MiB  655k m3u8  | avc1.64001F  655k video only
hls-fastly_skyfire_sep-655                        mp4 960x540     25 | ~999.85MiB  655k m3u8  | avc1.64001F  655k video only
dash-akfire_interconnect_quic-video-e22e0b59      mp4 960x540     25 | ~  1.71GiB 1149k dash  | avc1.64001F 1149k video only          DASH video, mp4_dash
dash-akfire_interconnect_quic_sep-video-e22e0b59  mp4 960x540     25 | ~  1.71GiB 1149k dash  | avc1.64001F 1149k video only          DASH video, mp4_dash
dash-fastly_skyfire-video-e22e0b59                mp4 960x540     25 | ~  1.71GiB 1149k dash  | avc1.64001F 1149k video only          DASH video, mp4_dash
dash-fastly_skyfire_sep-video-e22e0b59            mp4 960x540     25 | ~  1.71GiB 1149k dash  | avc1.64001F 1149k video only          DASH video, mp4_dash
hls-akfire_interconnect_quic-726                  mp4 1280x720    25 | ~  1.08GiB  726k m3u8  | avc1.640020  726k video only
hls-fastly_skyfire-726                            mp4 1280x720    25 | ~  1.08GiB  726k m3u8  | avc1.640020  726k video only
hls-akfire_interconnect_quic_sep-917              mp4 1280x720    25 | ~  1.37GiB  917k m3u8  | avc1.640020  917k video only
hls-fastly_skyfire_sep-917                        mp4 1280x720    25 | ~  1.37GiB  917k m3u8  | avc1.640020  917k video only
dash-akfire_interconnect_quic-video-0f745f59      mp4 1280x720    25 | ~  2.74GiB 1837k dash  | avc1.640020 1837k video only          DASH video, mp4_dash
dash-akfire_interconnect_quic_sep-video-0f745f59  mp4 1280x720    25 | ~  2.74GiB 1837k dash  | avc1.640020 1837k video only          DASH video, mp4_dash
dash-fastly_skyfire-video-0f745f59                mp4 1280x720    25 | ~  2.74GiB 1837k dash  | avc1.640020 1837k video only          DASH video, mp4_dash
dash-fastly_skyfire_sep-video-0f745f59            mp4 1280x720    25 | ~  2.74GiB 1837k dash  | avc1.640020 1837k video only          DASH video, mp4_dash
hls-akfire_interconnect_quic-1390                 mp4 1920x1080   25 | ~  2.07GiB 1390k m3u8  | avc1.64002A 1390k video only
hls-fastly_skyfire-1390                           mp4 1920x1080   25 | ~  2.07GiB 1390k m3u8  | avc1.64002A 1390k video only
hls-akfire_interconnect_quic_sep-1581             mp4 1920x1080   25 | ~  2.36GiB 1581k m3u8  | avc1.64002A 1581k video only
hls-fastly_skyfire_sep-1581                       mp4 1920x1080   25 | ~  2.36GiB 1581k m3u8  | avc1.64002A 1581k video only
dash-akfire_interconnect_quic-video-ba502be5      mp4 1920x1080   25 | ~  5.44GiB 3649k dash  | avc1.64002A 3649k video only          DASH video, mp4_dash
dash-akfire_interconnect_quic_sep-video-ba502be5  mp4 1920x1080   25 | ~  5.44GiB 3649k dash  | avc1.64002A 3649k video only          DASH video, mp4_dash
dash-fastly_skyfire-video-ba502be5                mp4 1920x1080   25 | ~  5.44GiB 3649k dash  | avc1.64002A 3649k video only          DASH video, mp4_dash
dash-fastly_skyfire_sep-video-ba502be5            mp4 1920x1080   25 | ~  5.44GiB 3649k dash  | avc1.64002A 3649k video only          DASH video, mp4_dash

... And if you've paid attention to [debug] line below:

[debug] [vimeo] Extracting URL: https://player.vimeo.com/video/764543723?h=f4a7f509ff&portfolio_id=1612641#__youtubedl_smuggle=%7B%22http_headers%22%3A+%7B%22Referer%22%3A+%22https%3A%2F%2Fvimeopro.com%2Fcadfem%2Fsimulation-conference-mechanische-systeme-in-perfektion%22%7D%7D

the code is doing what I did above 😜 ...

PRs in yt-dl to backport that functionality are always welcome...

tschüss 😃

dirkf commented 1 year ago

The --video_password ... option is passed transparently from the command line and has an effect only when implemented in a specific extractor. Currently there are 9 yt-dlp extractors that mention it, including Vimeo.

Actually the option is also supported in yt-dl, with 5 extractors, including Vimeo, supporting it. So no PRs are needed for the option itself.

PRs in yt-dl to backport that functionality are always welcome...

The vimeo:pro extraction is brand new. Pulling that would fix this:

It doesn't help here because the problem URL is never seen by the Vimeo extractor.

piknockyou commented 1 year ago

@dirkf my source only shows: https://player.vimeo.com/video/764543723?h=f4a7f509ff but not https://vimeo.com/764543723/f4a7f509ff?h=f4a7f509ff

dirkf commented 1 year ago

On checking I recall that you have to speak HTML, as the links are %-encoded (ll.65-66):

           <link rel="alternate" href="https://vimeo.com/api/oembed.json?url=https%3A%2F%2Fvimeo.com%2F764543723%2Ff4a7f509ff%3Fh%3Df4a7f509ff" type="application/json+oembed" title="Mechanische Systeme in Perfektion - Mechanische Systeme in Perfektion: Realit&auml;t erfassen, Innovation treiben">
                <link rel="alternate" href="https://vimeo.com/api/oembed.xml?url=https%3A%2F%2Fvimeo.com%2F764543723%2Ff4a7f509ff%3Fh%3Df4a7f509ff" type="text/xml+oembed" title="Mechanische Systeme in Perfektion - Mechanische Systeme in Perfektion: Realit&auml;t erfassen, Innovation treiben">
https%3A%2F%2Fvimeo.com%2F764543723%2Ff4a7f509ff%3Fh%3Df4a7f509ff
https:  /  /  vimeo.com/  764543723/  f4a7f509ff?  h=  f4a7f509ff
dirkf commented 1 year ago

I looked into this further and updated my earlier post.