[Broken] aenetworks - Partial fix with PR

StevenDTX commented 4 years ago

Checklist

[X] I'm reporting a broken site support
[X] I've verified that I'm running youtube-dlc version 2020.11.11-2
[X] I've checked that all provided URLs are alive and playable in a browser
[X] I've checked that all URLs and arguments with special characters are properly quoted or escaped
[X] I've searched the bugtracker for similar issues including closed ones

Verbose log

This URL works: https://play.mylifetime.com/shows/married-at-first-sight/season-11/episode-17

E:\>D:\scripts\youtube-dlc_build\yt-dlc\dist\youtube-dlc-20201116.exe --continue --no-check-certificate --ignore-errors --verbose --ap-mso --ap-username --ap-password -F https://play.mylifetime.com/shows/married-at-first-sight/season-11/episode-17
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['--continue', '--no-check-certificate', '--ignore-errors', '--verbose', '--ap-mso', 'Charter_Direct', '--ap-username', 'PRIVATE', '--ap-password', 'PRIVATE', '-F', 'https://play.mylifetime.com/shows/married-at-first-sight/season-11/episode-17']
[debug] Loading archive file None
[debug] Encodings: locale cp1252, fs utf-8, out utf-8, pref cp1252
[debug] youtube-dlc version 2020.11.11-2
[debug] Python version 3.7.2 (CPython) - Windows-10-10.0.18362
[debug] exe versions: ffmpeg N-92986-gaceb9131c1, ffprobe N-92986-gaceb9131c1, rtmpdump 2.4
[debug] Proxy map: {}
[aenetworks] married-at-first-sight/season-11/episode-17: Downloading webpage
[aenetworks] 1812818499705: Downloading JSON metadata
[aenetworks] 1812818499705: Downloading JSON metadata
[aenetworks] 1812818499705: Downloading hls_high_ak SMIL data
[aenetworks] 1812818499705: Downloading m3u8 information
[aenetworks] 1812818499705: Downloading high_video_s3 SMIL data
[aenetworks] 1812818499705: Checking video URL
[aenetworks] 1812818499705: Checking video URL
[aenetworks] 1812818499705: Checking video URL
[aenetworks] 1812818499705: Checking video URL
[aenetworks] 1812818499705: Checking video URL
[aenetworks] 1812818499705: Checking video URL
[aenetworks] 1812818499705: Checking video URL
[aenetworks] 1812818499705: Checking video URL
[aenetworks] 1812818499705: Downloading hls_ingest_fastly SMIL data
[info] Available formats for 1812818499705:
format code  extension  resolution note
http-162     mp4        320x180     162k
hls-179      mp4        320x180     179k , avc1.42c01e, 23.976fps, mp4a.40.2
http-326     mp4        320x180     326k
hls-359      mp4        320x180     359k , avc1.42c01e, 23.976fps, mp4a.40.2
http-529     mp4        448x252     529k
hls-572      mp4        448x252     572k , avc1.42c01e, 23.976fps, mp4a.40.2
http-824     mp4        512x288     824k
hls-885      mp4        512x288     885k , avc1.42c01e, 23.976fps, mp4a.40.2
http-1122    mp4        640x360    1122k
hls-1186     mp4        640x360    1186k , avc1.42c01e, 23.976fps, mp4a.40.2
http-1423    mp4        768x432    1423k
hls-1491     mp4        768x432    1491k , avc1.42c01e, 23.976fps, mp4a.40.2
http-1924    mp4        960x540    1924k
hls-2000     mp4        960x540    2000k , avc1.4d401f, 23.976fps, mp4a.40.2
http-2628    mp4        1280x720   2628k
hls-2704     mp4        1280x720   2704k , avc1.4d401f, 23.976fps, mp4a.40.2 (best)

This URL does not work: https://play.mylifetime.com/shows/married-at-first-sight/season-11/episode-14

E:\>D:\scripts\youtube-dlc_build\yt-dlc\dist\youtube-dlc-20201116.exe --continue --no-check-certificate --ignore-errors --verbose --ap-mso  --ap-username  --ap-password 2 -F https://play.mylifetime.com/shows/married-at-first-sight/season-11/episode-14
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['--continue', '--no-check-certificate', '--ignore-errors', '--verbose', '--ap-mso', 'Charter_Direct', '--ap-username', 'PRIVATE', '--ap-password', 'PRIVATE', '-F', 'https://play.mylifetime.com/shows/married-at-first-sight/season-11/episode-14']
[debug] Loading archive file None
[debug] Encodings: locale cp1252, fs utf-8, out utf-8, pref cp1252
[debug] youtube-dlc version 2020.11.11-2
[debug] Python version 3.7.2 (CPython) - Windows-10-10.0.18362
[debug] exe versions: ffmpeg N-92986-gaceb9131c1, ffprobe N-92986-gaceb9131c1, rtmpdump 2.4
[debug] Proxy map: {}
[aenetworks] married-at-first-sight/season-11/episode-14: Downloading webpage
[aenetworks] 1806111811633: Downloading JSON metadata
[aenetworks] 1806111811633: Downloading JSON metadata
[aenetworks] 1806111811633: Downloading Provider Redirect Page
ERROR: Unable to download webpage: HTTP Error 400: Bad Request (caused by <HTTPError 400: 'Bad Request'>); please report this issue on https://github.com/blackjack4494/yt-dlc . Make sure you are using the latest version; type  youtube-dlc -U  to update. Be sure to call youtube-dlc with the --verbose flag and include its complete output.
  File "youtube_dlc\extractor\common.py", line 632, in _request_webpage
  File "youtube_dlc\YoutubeDL.py", line 2316, in urlopen
  File "urllib\request.py", line 531, in open
  File "urllib\request.py", line 641, in http_response
  File "urllib\request.py", line 569, in error
  File "urllib\request.py", line 503, in _call_chain
  File "urllib\request.py", line 649, in http_error_default

Description

I merged this pull request: https://github.com/ytdl-org/youtube-dl/pull/26795

That works for some videos, but not all.

Thanks!

merval commented 3 years ago

It seems play.history.com is dealing with the same issue.

merval commented 3 years ago

Had to manually put your code change into mine, as your repo shows a DMCA takedown :-/ However, it works!

StevenDTX commented 3 years ago

Had to manually put your code change into mine, as your repo shows a DMCA takedown :-/ However, it works!

If you notice, the pull request is NOT mine. I merged it, and tested it, and it works some of the time. I was pointing out that it was only a partial fix.

merval commented 3 years ago

Looping back to this, I grabbed the code changes that were merged into ytdl-org and both of the links you provided appear to work without any issue. I'll file a PR for this.

StevenDTX commented 3 years ago

Looping back to this, I grabbed the code changes that were merged into ytdl-org and both of the links you provided appear to work without any issue. I'll file a PR for this.

https://play.mylifetime.com/shows/married-at-first-sight/season-11/episode-14 works for you? I still get a 401 error. I have tried with two different provider logins. I can view it in the browser.

merval commented 3 years ago

I just did a PR for the fix this morning. Do you have the source code you can run? Otherwise you'll have to wait for the next release

StevenDTX commented 3 years ago

I just did a PR for the fix this morning. Do you have the source code you can run? Otherwise you'll have to wait for the next release

I merged it as soon as the PR showed up on youtube-dl. As I said, it is only a partial fix. Not all episodes detect properly.

merval commented 3 years ago

I just did a PR for the fix this morning. Do you have the source code you can run? Otherwise you'll have to wait for the next release

I merged it as soon as the PR showed up on youtube-dl. As I said, it is only a partial fix. Not all episodes detect properly.

I tried the two that were listed and both worked. Are there other examples that don't work? I'd like to make sure it's a complete fix before merging it

StevenDTX commented 3 years ago

I just did a PR for the fix this morning. Do you have the source code you can run? Otherwise you'll have to wait for the next release

I merged it as soon as the PR showed up on youtube-dl. As I said, it is only a partial fix. Not all episodes detect properly.

I tried the two that were listed and both worked. Are there other examples that don't work? I'd like to make sure it's a complete fix before merging it

Definitely not working correctly for me on all aenetworks urls. The two referenced above, the first one works, but the second, I get a different error now. WHat MSO provider are you using? I have tried DTV and Charter_Direct. Its my understanding that Charter_Direct has been deprecated, but Spectrum isnt working yet.

U:\>C:\support\youtube-dl-20201116-AETV.exe --continue --no-check-certificate --ignore-errors --verbose --ap-mso DTV --ap-username <USERNAME> --ap-password <PASSWORD> -o "D:\scripts\Auto-TV-Download\TEMP\temp.S01E07..WEB-DL.mp4" "https://play.mylifetime.com/shows/married-at-first-sight/season-11/episode-14"
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['--continue', '--no-check-certificate', '--ignore-errors', '--verbose', '--ap-mso', 'DTV', '--ap-username', 'PRIVATE', '--ap-password', 'PRIVATE', '-o', 'D:\\scripts\\Auto-TV-Download\\TEMP\\temp.S01E07..WEB-DL.mp4', 'https://play.mylifetime.com/shows/married-at-first-sight/season-11/episode-14']
[debug] Encodings: locale cp1252, fs utf-8, out utf-8, pref cp1252
[debug] youtube-dl version 2020.11.12
[debug] Python version 3.7.2 (CPython) - Windows-10-10.0.19041
[debug] exe versions: ffmpeg N-100433-g50a9210739, ffprobe N-100433-g50a9210739
[debug] Proxy map: {}
[aenetworks] married-at-first-sight/season-11/episode-14: Downloading webpage
[aenetworks] 1806111811633: Downloading JSON metadata
ERROR: Unable to download JSON metadata: HTTP Error 503: Service Unavailable (caused by <HTTPError 503: 'Service Unavailable'>); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
  File "youtube_dl\extractor\common.py", line 632, in _request_webpage
  File "youtube_dl\YoutubeDL.py", line 2238, in urlopen
  File "urllib\request.py", line 531, in open
  File "urllib\request.py", line 641, in http_response
  File "urllib\request.py", line 569, in error
  File "urllib\request.py", line 503, in _call_chain
  File "urllib\request.py", line 649, in http_error_default

merval commented 3 years ago

[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['https://play.mylifetime.com/shows/married-at-first-sight/season-11/episode-14', '--ap-mso', 'Comcast_SSO', '--ap-username', 'PRIVATE', '--ap-password', 'PRIVATE', '--verbose']
[debug] Loading archive file None
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dlc version 2020.11.11-2
[debug] Git HEAD: cdb3873dc
[debug] Python version 3.7.3 (CPython) - Darwin-19.6.0-x86_64-i386-64bit
[debug] exe versions: ffmpeg 4.3.1, ffprobe 4.3.1, rtmpdump 2.4
[debug] Proxy map: {}
[aenetworks] shows/married-at-first-sight/season-11/episode-14: Downloading JSON metadata
[aenetworks] 1806111811633: Downloading JSON metadata
[aenetworks] 1806111811633: Retrieving Media Token
[aenetworks] 1806111811633: Downloading hls_high_ak SMIL data
[aenetworks] 1806111811633: Downloading m3u8 information
[aenetworks] 1806111811633: Downloading high_video_s3 SMIL data
[aenetworks] 1806111811633: Checking video URL
[aenetworks] 1806111811633: Checking video URL
[aenetworks] 1806111811633: Checking video URL
[aenetworks] 1806111811633: Checking video URL
[aenetworks] 1806111811633: Checking video URL
[aenetworks] 1806111811633: Checking video URL
[aenetworks] 1806111811633: Checking video URL
[aenetworks] 1806111811633: Checking video URL
[aenetworks] 1806111811633: Downloading hls_high_fastly SMIL data
[aenetworks] 1806111811633: Downloading m3u8 information
[debug] Default format spec: bestvideo+bestaudio/best
[debug] Invoking downloader on 'https://aetv.global.ssl.fastly.net/token/aGRudHM9c3Q9MTYwODkyMDQ5NX5leHA9MTYwODk0MjEyNX5hY2w9L2kvQUVUTi1MaWZldGltZV9WTVMvQlJBTkRfTEZUX01BRlNfMjMzODA1X05MTV8zODk0MDhfMjM5OF8xMjBfMjAyMDEwMTJfMDFfMTAxMjAzMF9TM18qfmhtYWM9ODE2ZGZiNmQwMmE4OGNiMTM1ZjBmOTAwOTY5MGRhZWUzN2ZhMjcxYjU1NTU3ODczMmM4OThkYWJkOGM3YzM1Mg==/AETN-Lifetime_VMS/BRAND_LFT_MAFS_233805_NLM_389408_2398_120_20201012_01_1012030_S3_2500.mp4.m3u8'
[download] Destination: Stranger Spouse-1806111811633.mp4

Even without an MSO login it works:

[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['https://play.mylifetime.com/shows/married-at-first-sight/season-11/episode-14', '--verbose']
[debug] Loading archive file None
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dlc version 2020.11.11-2
[debug] Git HEAD: cdb3873dc
[debug] Python version 3.7.3 (CPython) - Darwin-19.6.0-x86_64-i386-64bit
[debug] exe versions: ffmpeg 4.3.1, ffprobe 4.3.1, rtmpdump 2.4
[debug] Proxy map: {}
[aenetworks] shows/married-at-first-sight/season-11/episode-14: Downloading JSON metadata
[aenetworks] 1806111811633: Downloading JSON metadata
[aenetworks] 1806111811633: Retrieving Media Token
[aenetworks] 1806111811633: Downloading hls_high_ak SMIL data
[aenetworks] 1806111811633: Downloading m3u8 information
[aenetworks] 1806111811633: Downloading high_video_s3 SMIL data
[aenetworks] 1806111811633: Checking video URL
[aenetworks] 1806111811633: Checking video URL
[aenetworks] 1806111811633: Checking video URL
[aenetworks] 1806111811633: Checking video URL
[aenetworks] 1806111811633: Checking video URL
[aenetworks] 1806111811633: Checking video URL
[aenetworks] 1806111811633: Checking video URL
[aenetworks] 1806111811633: Checking video URL
[aenetworks] 1806111811633: Downloading hls_high_fastly SMIL data
[aenetworks] 1806111811633: Downloading m3u8 information
[debug] Default format spec: bestvideo+bestaudio/best
[debug] Invoking downloader on 'https://aetv.global.ssl.fastly.net/token/aGRudHM9c3Q9MTYwODkyMDcxNX5leHA9MTYwODk0MjM0NX5hY2w9L2kvQUVUTi1MaWZldGltZV9WTVMvQlJBTkRfTEZUX01BRlNfMjMzODA1X05MTV8zODk0MDhfMjM5OF8xMjBfMjAyMDEwMTJfMDFfMTAxMjAzMF9TM18qfmhtYWM9YzZhMGNkOTE4MTAzODg1YzVjNzYyM2I4NTU4Yjg5OWZjZGEwN2YxNjQ5Zjk4MjI5YWZiZTIzZDg3ODMzMTgzNQ==/AETN-Lifetime_VMS/BRAND_LFT_MAFS_233805_NLM_389408_2398_120_20201012_01_1012030_S3_2500.mp4.m3u8'
[download] Destination: Stranger Spouse-1806111811633.mp4

blackjack4494 / yt-dlc