ytdl-org / youtube-dl

Command-line program to download videos from YouTube.com and other video sites
http://ytdl-org.github.io/youtube-dl/
The Unlicense
131.77k stars 9.98k forks source link

Disney Now Unable to extract post url - DirecTV #30726

Open czesardine opened 2 years ago

czesardine commented 2 years ago

Checklist

Verbose log

[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['--list-formats', '--verbose', 'https://disneynow.com/shows/roman-to-the-rescue/season-01/episode-07-asher/vdka26623601', '--ap-mso', 'DTV', '--ap-username', 'PRIVATE', '--ap-password', 'PRIVATE']
[debug] Encodings: locale cp1252, fs mbcs, out cp850, pref cp1252
[debug] youtube-dl version 2021.12.17
[debug] Python version 3.4.4 (CPython) - Windows-10-10.0.22000
[debug] exe versions: ffmpeg git-2020-06-28-4cfcfb3, ffprobe git-2020-06-28-4cfcfb3
[debug] Proxy map: {}
[Go] vdka26623601: Downloading JSON metadata
[Go] VDKA26623601: Downloading Provider Redirect Page
[Go] VDKA26623601: Downloading Provider Login Page
ERROR: Unable to extract post url; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
Traceback (most recent call last):
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpupik7c6w\build\youtube_dl\YoutubeDL.py", line 815, in wrapper
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpupik7c6w\build\youtube_dl\YoutubeDL.py", line 836, in __extract_info
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpupik7c6w\build\youtube_dl\extractor\common.py", line 534, in extract
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpupik7c6w\build\youtube_dl\extractor\go.py", line 234, in _real_extract
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpupik7c6w\build\youtube_dl\extractor\adobepass.py", line 1513, in _extract_mvpd_auth
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpupik7c6w\build\youtube_dl\extractor\adobepass.py", line 1365, in post_form
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpupik7c6w\build\youtube_dl\extractor\common.py", line 1021, in _html_search_regex
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpupik7c6w\build\youtube_dl\extractor\common.py", line 1012, in _search_regex
youtube_dl.utils.RegexNotFoundError: Unable to extract post url; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.

Description

Free videos work fine. It's with the "premium" videos where I got issues. Right now I'm not logged in with my TV provider at youtube-dl, and it asks me for my user, and when I enter it...

G:\Downloads\Youtube\youtube-dl>youtube-dl --list-formats https://disneynow.com/shows/roman-to-the-rescue/season-01/episode-07-asher/vdka26623601 --ap-mso DTV --ap-username xxxx@yyyy --ap-password aaaa
[Go] vdka26623601: Downloading JSON metadata
[Go] VDKA26623601: Downloading Provider Redirect Page
[Go] VDKA26623601: Downloading Provider Login Page
ERROR: Unable to extract post url; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.

I read a very old ticket with the same issue, and apparently the problem was the TV provider didn't have support, but DirecTV was working fine.

ap-username and ap-password have been hidden, but they are correct when I enter them.

Plus: During writing this, I used a laptop where I was logged in, and it works fine, so I guess I just can't log in. Extra: My account was flagged as soon as I posted this last week (being this my first and only repository), so it is invisible, I guess.

dirkf commented 2 years ago

Please provide verbose log (-v/--verbose) to show the error backtrace:

youtube-dl --list-formats --verbose https://disneynow.com/shows/roman-to-the-rescue/season-01/episode-07-asher/vdka26623601 --ap-mso DTV --ap-username xxxx@yyyy --ap-password aaaa

However this looks like the same issue as #29191 and this too, though the issue did not include a verbose log that would have confirmed it.

Also: #26139, #28717.

czesardine commented 2 years ago

Please provide verbose log (-v/--verbose) to show the error backtrace:

youtube-dl --list-formats --verbose https://disneynow.com/shows/roman-to-the-rescue/season-01/episode-07-asher/vdka26623601 --ap-mso DTV --ap-username xxxx@yyyy --ap-password aaaa

However this looks like the same issue as #29191 and this too, though the issue did not include a verbose log that would have confirmed it.

Also: #26139, #28717.

Sorry, completely misunderstood the indication. Just edited the verbose log.

dirkf commented 2 years ago

These do appear all to be same problem. Possibly the "Provider Login Page" that the extractor thinks it is getting is actually some other page entirely.

There is also a suggestion that (eg) Comcast requires you to be connected via its ISP, just to make debugging even more tricky.

PR #30649 may also be needed for some shows whose metadata requires a new API version.

octavioj commented 1 year ago

This is also happening in NBC sites as well. With videos that do not require login they download fine. For videos that require provider login, one also gets the error of unable to extract post url. Here is an example:

[debug] Command-line config: ['--ap-mso', 'Charter_Direct', '--ap-username', 'PRIVATE', '--ap-password', 'PRIVATE', '-o', '%(series)s - S%(season_number)sE%(episode_number)s - %(episode)s.%(ext)s', '--cookies', '/userfiles/Downloads/Firefox Downloads/cookies.txt', '-vvv', '-s', 'https://www.nbc.com/the-ark/video/every-single-person-matters/9000326419'] [debug] Encodings: locale UTF-8, fs utf-8, pref UTF-8, out utf-8, error utf-8, screen utf-8 [debug] yt-dlp version stable@2023.03.04 [392389b7d] (pip) [debug] Python 3.10.6 (CPython x86_64 64bit) - Linux-5.15.0-67-generic-x86_64-with-glibc2.35 (OpenSSL 3.0.2 15 Mar 2022, glibc 2.35) [debug] exe versions: ffmpeg 4.4.2 (setts), ffprobe 4.4.2, rtmpdump 2.4 [debug] Optional libraries: Cryptodome-3.11.0, brotli-1.0.9, certifi-2020.06.20, mutagen-1.45.1, pyxattr-0.7.2, secretstorage-3.3.1, sqlite3-2.6.0, websockets-10.3 [debug] Proxy map: {} [debug] Loaded 1786 extractors [NBC] Extracting URL: https://www.nbc.com/the-ark/video/every-single-person-matters/9000326419 [NBC] 9000326419: Downloading JSON metadata [NBC] 9000326419: Downloading JSON metadata [NBC] 9000326419: Downloading Provider Redirect Page ERROR: [NBC] 9000326419: Unable to extract post url; please report this issue on https://github.com/yt-dlp/yt-dlp/issues?q= , filling out the appropriate issue template. Confirm you are on the latest version using yt-dlp -U File "/home/vagrant/.local/lib/python3.10/site-packages/yt_dlp/extractor/common.py", line 694, in extract ie_result = self._real_extract(url) File "/home/vagrant/.local/lib/python3.10/site-packages/yt_dlp/extractor/nbc.py", line 204, in _real_extract query['auth'] = self._extract_mvpd_auth( File "/home/vagrant/.local/lib/python3.10/site-packages/yt_dlp/extractor/adobepass.py", line 1707, in _extract_mvpd_auth provider_login_page_res = post_form( File "/home/vagrant/.local/lib/python3.10/site-packages/yt_dlp/extractor/adobepass.py", line 1395, in post_form post_url = self._html_search_regex(r'<form[^>]+action=(["\'])(?P.+?)\1', form_page, 'post url', group='url') File "/home/vagrant/.local/lib/python3.10/site-packages/yt_dlp/extractor/common.py", line 1278, in _html_search_regex res = self._search_regex(pattern, string, name, default, fatal, flags, group) File "/home/vagrant/.local/lib/python3.10/site-packages/yt_dlp/extractor/common.py", line 1242, in _search_regex raise RegexNotFoundError('Unable to extract %s' % _name)