search

ytdl-org / youtube-dl

Command-line program to download videos from YouTube.com and other video sites
http://ytdl-org.github.io/youtube-dl/
The Unlicense
131.35k stars 9.95k forks source link

Zoom #32094

Open gklimm opened 1 year ago

gklimm commented 1 year ago

Checklist

Verbose log

[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['--verbose', 'https://us02web.zoom.us/rec/share/9pdVT4f2XWBaEOSqDJagSsvI0Yu2ixXW0YcJGIVhfV19Zr7E1q5gf0wTMZHnqrvq.Yoq1dDHeeKjaVcv3']
[debug] Encodings: locale UTF-8, fs utf-8, out utf-8, pref UTF-8
[debug] youtube-dl version 2021.12.17
[debug] Python version 3.9.2 (CPython) - Linux-5.10.0-21-amd64-x86_64-with-glibc2.31
[debug] exe versions: ffmpeg 4.4.4, ffprobe 4.4.4, rtmpdump 2.4
[debug] Proxy map: {}
[zoom] 9pdVT4f2XWBaEOSqDJagSsvI0Yu2ixXW0YcJGIVhfV19Zr7E1q5gf0wTMZHnqrvq.Yoq1dDHeeKjaVcv3: Downloading webpage
ERROR: An extractor error has occurred. (caused by KeyError('topic')); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
Traceback (most recent call last):
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 534, in extract
    ie_result = self._real_extract(url)
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/zoom.py", line 60, in _real_extract
    'title': data['topic'],
KeyError: 'topic'
Traceback (most recent call last):
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 534, in extract
    ie_result = self._real_extract(url)
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/zoom.py", line 60, in _real_extract
    'title': data['topic'],
KeyError: 'topic'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 815, in wrapper
    return func(self, *args, **kwargs)
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 836, in __extract_info
    ie_result = ie.extract(url)
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 547, in extract
    raise ExtractorError('An extractor error has occurred.', cause=e)
youtube_dl.utils.ExtractorError: An extractor error has occurred. (caused by KeyError('topic')); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.

Description

WRITE DESCRIPTION HERE

dirkf commented 1 year ago

Does this play for you? I get "Untersuchungskurs Gruppe V- Shared screen with speaker view" and a player widget with an unresponsive play button and the text "No compatible source was found for this media."

However, I can reproduce the above.

yt-dlp also fails but with: [zoom] 9pdVT4f2XWBaEOSqDJagSsvI0Yu2ixXW0YcJGIVhfV19Zr7E1q5gf0wTMZHnqrvq.Yoq1dDHeeKjaVcv3: No video formats found!

october262 commented 1 year ago

video plays ok for me, you can also just right click on the video and click "save as" to download the video in mp4 format. yt-dlp & youtube-dl doesn't work for me either, however ytdl-patched does download this video.

gklimm commented 1 year ago

Yes, ytdl-patched works fine! Hope that @shiningw takes this in future for the ncdownloader

dirkf commented 1 year ago

The yt-dlp from ytdl-patched or from a nightly build in the yt-dlp repo includes https://github.com/yt-dlp/yt-dlp/pull/6789 which fixes Zoom extraction. Quite a painless backport gives this yt-dl result:

$ python -m youtube_dl -F -v 'https://us02web.zoom.us/rec/share/9pdVT4f2XWBaEOSqDJagSsvI0Yu2ixXW0YcJGIVhfV19Zr7E1q5gf0wTMZHnqrvq.Yoq1dDHeeKjaVcv3'
[debug] System config: [u'--prefer-ffmpeg']
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'-F', u'-v', u'https://us02web.zoom.us/rec/share/9pdVT4f2XWBaEOSqDJagSsvI0Yu2ixXW0YcJGIVhfV19Zr7E1q5gf0wTMZHnqrvq.Yoq1dDHeeKjaVcv3']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2021.12.17
[debug] Git HEAD: 64d6dd64c
[debug] Python version 2.7.18 (CPython) - Linux-4.4.0-210-generic-i686-with-Ubuntu-16.04-xenial
[debug] exe versions: avconv 4.3, avprobe 4.3, ffmpeg 4.3, ffprobe 4.3
[debug] Proxy map: {}
[zoom] Extracting URL: https://us02web.zoom.us/rec/share/9pdVT4f2XWBaEOSqDJagSsvI0Yu2ixXW0YcJGIVhfV19Zr7E1q5gf0wTMZHnqrvq.Yoq1dDHeeKjaVcv3
[zoom] 9pdVT4f2XWBaEOSqDJagSsvI0Yu2ixXW0YcJGIVhfV19Zr7E1q5gf0wTMZHnqrvq.Yoq1dDHeeKjaVcv3: Downloading share webpage
[zoom] 9pdVT4f2XWBaEOSqDJagSsvI0Yu2ixXW0YcJGIVhfV19Zr7E1q5gf0wTMZHnqrvq.Yoq1dDHeeKjaVcv3: Downloading share info JSON
[zoom] 9pdVT4f2XWBaEOSqDJagSsvI0Yu2ixXW0YcJGIVhfV19Zr7E1q5gf0wTMZHnqrvq.Yoq1dDHeeKjaVcv3: Downloading play webpage
[zoom] 9pdVT4f2XWBaEOSqDJagSsvI0Yu2ixXW0YcJGIVhfV19Zr7E1q5gf0wTMZHnqrvq.Yoq1dDHeeKjaVcv3: Downloading play info JSON
[info] Available formats for 9pdVT4f2XWBaEOSqDJagSsvI0Yu2ixXW0YcJGIVhfV19Zr7E1q5gf0wTMZHnqrvq.Yoq1dDHeeKjaVcv3:
format code                           extension  resolution note
9579c7e5-0fc8-4d1d-b0db-32077cfa3316  mp4        1920x1080  Camera stream , ~658.04MiB
$

It's a rewrite rather than a small patch so it'll have to wait for a PR.

gklimm commented 1 year ago

This reads as if metadata would then come again and perhaps a meaningful file name would be generated. That would be awesome

dirkf commented 1 year ago

The problem page will generate this filename: Untersuchungskurs Gruppe V-9pdVT4f2XWBaEOSqDJagSsvI0Yu2ixXW0YcJGIVhfV19Zr7E1q5gf0wTMZHnqrvq.Yoq1dDHeeKjaVcv3.mp4

Awesomeness may be in the eye of the beholder.

catleeball commented 1 year ago

Just commenting that I also encountered this issue. Unfortunately, when I try the right-click + save as workaround, it produces a small file that isn't a valid .mp4 file.

The ytdl-patched workaround did work for me though! Logs for both below.

youtube-dl error:

[16:31:13]
> youtube-dl --verbose --add-header 'cookie: ...redacted...' 'https://washington.zoom.us/rec/play/UPjP7VaelDL2IAKpzLrTrMa5ciJ9gjAqH-2nBtkySW5FukqBgnkpuDAHhLcENKXavjTNVWPHe9kA7-iJ._awsA_5KGfasvF5C' | tee youtube-dl.log
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['--verbose', '--add-header', 'cookie: ...redacted...', 'https://washington.zoom.us/rec/play/UPjP7VaelDL2IAKpzLrTrMa5ciJ9gjAqH-2nBtkySW5FukqBgnkpuDAHhLcENKXavjTNVWPHe9kA7-iJ._awsA_5KGfasvF5C']
[debug] Adding header from command line option cookie: ...redacted...
[debug] Encodings: locale UTF-8, fs utf-8, out utf-8, pref UTF-8
[debug] youtube-dl version 2021.12.17
[debug] Python version 3.9.13 (CPython) - macOS-10.16-x86_64-i386-64bit
[debug] exe versions: ffmpeg 6.0, ffprobe 6.0, phantomjs 2.1.1, rtmpdump 2.4
[debug] Proxy map: {}
[zoom] UPjP7VaelDL2IAKpzLrTrMa5ciJ9gjAqH-2nBtkySW5FukqBgnkpuDAHhLcENKXavjTNVWPHe9kA7-iJ._awsA_5KGfasvF5C: Downloading webpage
ERROR: An extractor error has occurred. (caused by KeyError('topic')); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
Traceback (most recent call last):
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 534, in extract
    ie_result = self._real_extract(url)
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/zoom.py", line 60, in _real_extract
    'title': data['topic'],
KeyError: 'topic'
Traceback (most recent call last):
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 534, in extract
    ie_result = self._real_extract(url)
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/zoom.py", line 60, in _real_extract
    'title': data['topic'],
KeyError: 'topic'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 815, in wrapper
    return func(self, *args, **kwargs)
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 836, in __extract_info
    ie_result = ie.extract(url)
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 547, in extract
    raise ExtractorError('An extractor error has occurred.', cause=e)
youtube_dl.utils.ExtractorError: An extractor error has occurred. (caused by KeyError('topic')); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.

[ 4s085 | Jun 03 04:32PM ]
>

ytdl-patched success:

[16:34:06]
> ytdl-patched --verbose --add-header 'cookie: ...redacted...' 'https://washington.zoom.us/rec/play/UPjP7VaelDL2IAKpzLrTrMa5ciJ9gjAqH-2nBtkySW5FukqBgnkpuDAHhLcENKXavjTNVWPHe9kA7-iJ._awsA_5KGfasvF5C'
[debug] Command-line config: ['--verbose', '--add-header', 'cookie: ...redacted...', 'https://washington.zoom.us/rec/play/UPjP7VaelDL2IAKpzLrTrMa5ciJ9gjAqH-2nBtkySW5FukqBgnkpuDAHhLcENKXavjTNVWPHe9kA7-iJ._awsA_5KGfasvF5C']
[debug] Encodings: locale UTF-8, fs utf-8, pref UTF-8, out utf-8 (No ANSI), error utf-8, screen utf-8 (No ANSI)
[debug] ytdl-patched version stable@2023.06.03.1685794368 [b9ed90fbe] (zip)
[debug]      from commit b9ed90fbe
[debug]      based on 2fb35f600
[debug] ** The command you are running is not yt-dlp.
[debug] ** Please make bug reports at https://github.com/ytdl-patched/ytdl-patched/issues/new/choose instead.
[debug] Lazy loading extractors is disabled
[debug] Python 3.9.13 (CPython x86_64 64bit) - macOS-10.16-x86_64-i386-64bit (OpenSSL 1.1.1q  5 Jul 2022)
[debug] exe versions: ffmpeg 6.0 (setts), ffprobe 6.0, phantomjs 2.1.1, rtmpdump 2.4
[debug] Optional libraries: WebSocketClientWrapper-None, brotli-None, certifi-2022.09.24, sqlite3-2.6.0
[debug] Proxy map: {}
[debug] Loaded 1874 extractors
[zoom] Extracting URL: https://washington.zoom.us/rec/play/UPjP7VaelDL2IAKpzLrTrMa5ciJ9gjAqH-2nBtkySW5FukqBgnkpuDAHhLcENKXavjTNVWPHe9kA7-iJ._awsA_5KGfasvF5C
[zoom] UPjP7VaelDL2IAKpzLrTrMa5ciJ9gjAqH-2nBtkySW5FukqBgnkpuDAHhLcENKXavjTNVWPHe9kA7-iJ._awsA_5KGfasvF5C: Downloading play webpage
[zoom] [debug] Fetching webpage from https://washington.zoom.us/rec/play/UPjP7VaelDL2IAKpzLrTrMa5ciJ9gjAqH-2nBtkySW5FukqBgnkpuDAHhLcENKXavjTNVWPHe9kA7-iJ._awsA_5KGfasvF5C
[zoom] UPjP7VaelDL2IAKpzLrTrMa5ciJ9gjAqH-2nBtkySW5FukqBgnkpuDAHhLcENKXavjTNVWPHe9kA7-iJ._awsA_5KGfasvF5C: Downloading play info JSON
[zoom] [debug] Fetching webpage from https://washington.zoom.us/nws/recording/1.0/play/info/CouDd0Bb75NV-fxSOk96HlKlFeoV_Z2yQO8mGcciSTiOeoTFdxwW3PjYD7ty9Vc7aNJZfu6JPPWRFYPl.uBww1Hy1fk8XwT52
[debug] Formats sorted by: hasvid, ie_pref, lang, quality, res, fps, hdr:12(7), vcodec:vp9.2(10), channels, acodec, filesize, fs_approx, tbr, vbr, abr, asr, proto, vext, aext, hasaud, source, id
[debug] Default format spec: bestvideo*+bestaudio/best
[info] UPjP7VaelDL2IAKpzLrTrMa5ciJ9gjAqH-2nBtkySW5FukqBgnkpuDAHhLcENKXavjTNVWPHe9kA7-iJ._awsA_5KGfasvF5C: Downloading 1 format(s): 0807a70a-92fc-4d3f-aeb6-30a1851f52f1
[debug] Invoking http downloader on "https://ssrweb.zoom.us/replay02/2023/05/31/D8D0B8AB-C288-492B-83EE-9DC5A2309AE1/GMT20230530-223029_Recording_2560x1440.mp4?response-content-type=video%2Fmp4&response-cache-control=max-age%3D0%2Cs-maxage%3D86400&data=dca60b94a2370c6571ce27392a82716217250f27b314d0cd3086095124229a81&s001=yes&cid=aw1&fid=BQF5e8QzKZDaXDts0UGVpb-kde2q8R9M01dE332IAWhxev_bTIW8rc3e__R-fJux97ZquH2xOJFI9Xwq.9bmRE3sYSEWyNBN8&s002=cBqebhz_MnFcXiKiwyKDDIyCY6uAKkOM8Guu4Ai7s8Vd3N0CAJhohVRAVA.NfznprD9pVLGU9ag&tid=v=2.0;clid=aw1;rid=WEB_1cebfa12d336c123253b23a937a2f77b&Policy=eyJTdGF0ZW1lbnQiOiBbeyJSZXNvdXJjZSI6Imh0dHBzOi8vc3Nyd2ViLnpvb20udXMvcmVwbGF5MDIvMjAyMy8wNS8zMS9EOEQwQjhBQi1DMjg4LTQ5MkItODNFRS05REM1QTIzMDlBRTEvR01UMjAyMzA1MzAtMjIzMDI5X1JlY29yZGluZ18yNTYweDE0NDAubXA0P3Jlc3BvbnNlLWNvbnRlbnQtdHlwZT12aWRlbyUyRm1wNCZyZXNwb25zZS1jYWNoZS1jb250cm9sPW1heC1hZ2UlM0QwJTJDcy1tYXhhZ2UlM0Q4NjQwMCZkYXRhPWRjYTYwYjk0YTIzNzBjNjU3MWNlMjczOTJhODI3MTYyMTcyNTBmMjdiMzE0ZDBjZDMwODYwOTUxMjQyMjlhODEmczAwMT15ZXMmY2lkPWF3MSZmaWQ9QlFGNWU4UXpLWkRhWER0czBVR1ZwYi1rZGUycThSOU0wMWRFMzMySUFXaHhldl9iVElXOHJjM2VfX1ItZkp1eDk3WnF1SDJ4T0pGSTlYd3EuOWJtUkUzc1lTRVd5TkJOOCZzMDAyPWNCcWViaHpfTW5GY1hpS2l3eUtEREl5Q1k2dUFLa09NOEd1dTRBaTdzOFZkM04wQ0FKaG9oVlJBVkEuTmZ6bnByRDlwVkxHVTlhZyZ0aWQ9dj0yLjA7Y2xpZD1hdzE7cmlkPVdFQl8xY2ViZmExMmQzMzZjMTIzMjUzYjIzYTkzN2EyZjc3YiIsIkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTY4NTg0NzcwNH19fV19&Signature=WNwvaVAe6-E5jPokdP8FaoUBoQNLIe5Kfr1s77W6o9JZcI7T6mSpG1yooSu~pr9Y6hVshcmNkzLQ-bmvJh5huKuPIPpWtYPquQsRmWIu-bUYMWE47Y4L7lximG0W3fmI0eyL3haRpQootVgsJuPSqMY1ETK1uFYhO2o963Z2uA3EB58MIh0SbxVJiBDal5hCi9GrDknPxBd1IggytRY12yEhfdiWDA7zHQ6uhdiz9aT7szfnOm7ulX7H0pho8m1lRqDXMWb-g0yfAlckrY0yvu4SjaG3Z82L42i7wRMCLy8A1MezjSmGMOGJE23g0sLMYzxBSkuS833XPqqoyoDpSQ__&Key-Pair-Id=APKAJFHNSLHYCGFYQGIA"
[download] Destination: LING 575 D Sp 23: Topics In Computational Linguistics [UPjP7VaelDL2IAKpzLrTrMa5ciJ9gjAqH-2nBtkySW5FukqBgnkpuDAHhLcENKXavjTNVWPHe9kA7-iJ._awsA_5KGfasvF5C].mp4
[download] 100% of 581.10MiB in 00:15 at 38.72MiB/s  
[debug] Cleaning up 1 streams
                                                                                                                                                                [ 30s482 | Jun 03 04:35PM ]
[16:35:23]
>
thiswillbeyourgithub commented 5 months ago

Still present today in the latest git version. That's too bad

dirkf commented 2 months ago

If anyone cares to test the linked PR, please report there.