search

ytdl-org / youtube-dl

Command-line program to download videos from YouTube.com and other video sites
http://ytdl-org.github.io/youtube-dl/
The Unlicense
132.74k stars 10.07k forks source link

Not support http://video.caixin.com/2016-11-10/101006167.html #11283

Open KwToPA opened 8 years ago

KwToPA commented 8 years ago 
proxychains4 youtube-dl -v http://video.caixin.com/2016-11-10/101006167.html
[proxychains] config file found: /usr/local/Cellar/proxychains-ng/4.7/etc/proxychains.conf
[proxychains] preloading /usr/local/Cellar/proxychains-ng/4.7/lib/libproxychains4.dylib
[proxychains] DLL init
[debug] System config: []
[debug] User config: []
[debug] Command-line args: [u'-v', u'http://video.caixin.com/2016-11-10/101006167.html']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2016.11.22
[proxychains] DLL init
[debug] Python version 2.7.9 - Darwin-14.5.0-x86_64-i386-64bit
[debug] exe versions: ffmpeg 3.0.1-tessus
[debug] Proxy map: {}
[generic] 101006167: Requesting header
[proxychains] Strict chain  ...  127.0.0.1:1080  ...  video.caixin.com:80  ...  OK
WARNING: Falling back on generic information extractor.
[generic] 101006167: Downloading webpage
[proxychains] Strict chain  ...  127.0.0.1:1080  ...  video.caixin.com:80  ...  OK
[generic] 101006167: Extracting information
ERROR: Unsupported URL: http://video.caixin.com/2016-11-10/101006167.html

I found a m3u8 url using developer tools

http://101.69.135.251/234/42/31/bcloud/800957/ver_00_22-1072044892-avc-938269-aac-77375-11614240-1490692133-5876c859ec209c280c24ddb8dd3c87eb-1478766957606.m3u8?crypt=79aa7f2e1154&b=1026&nlh=4096&nlt=60&bf=90&p2p=1&video_type=mp4&termid=1&tss=ios&platid=2&splatid=207&its=0&qos=5&fcheck=0&amltag=59888&mltag=59888&proxy=1699055385,1699073726,467476968&uid=1698983025.rp&keyitem=GOw_33YJAAbXYE-cnQwpfLlv_b2zAkYctFVqe5bsXQpaGNn3T1-vhw..&ntm=1479966600&nkey=41e3f95f543d32d20c665c83c0f4689e&nkey2=629a08547753575bae83c59311a3f3d1&geo=CN-11-143-2&mmsid=212593520&tm=1479948543643&key=58d94f80f21d9c79333bb7c9168b1dd8&payff=0&cuid=800957&vtype=28&dur=11614&p1=3&p2=30&p3=300&cf=flash&p=101&playid=0&tag=flash&sign=bcloud_800957&pay=0&ostype=windows&hwtype=un&ctv=pc&m3v=1&ch=800957&tn=0.5598899112083018&uuid=D400F53BC9369C002A13C58B4621A4EF29028F14&vid=37387402&rateid=27&errc=0&gn=1198&vrtmcd=102&buss=59888&cips=101.68.108.113
proxychains4 youtube-dl -v http://101.69.135.251/234/42/31/bcloud/800957/ver_00_22-1072044892-avc-938269-aac-77375-11614240-1490692133-5876c859ec209c280c24ddb8dd3c87eb-1478766957606.m3u8?crypt=79aa7f2e1154&b=1026&nlh=4096&nlt=60&bf=90&p2p=1&video_type=mp4&termid=1&tss=ios&platid=2&splatid=207&its=0&qos=5&fcheck=0&amltag=59888&mltag=59888&proxy=1699055385,1699073726,467476968&uid=1698983025.rp&keyitem=GOw_33YJAAbXYE-cnQwpfLlv_b2zAkYctFVqe5bsXQpaGNn3T1-vhw..&ntm=1479966600&nkey=41e3f95f543d32d20c665c83c0f4689e&nkey2=629a08547753575bae83c59311a3f3d1&geo=CN-11-143-2&mmsid=212593520&tm=1479948543643&key=58d94f80f21d9c79333bb7c9168b1dd8&payff=0&cuid=800957&vtype=28&dur=11614&p1=3&p2=30&p3=300&cf=flash&p=101&playid=0&tag=flash&sign=bcloud_800957&pay=0&ostype=windows&hwtype=un&ctv=pc&m3v=1&ch=800957&tn=0.5598899112083018&uuid=D400F53BC9369C002A13C58B4621A4EF29028F14&vid=37387402&rateid=27&errc=0&gn=1198&vrtmcd=102&buss=59888&cips=101.68.108.113
[1] 1636
[2] 1637
[3] 1638
[4] 1639
[5] 1640
[6] 1641
[7] 1642
[8] 1643
[9] 1644
[10] 1645
[11] 1646
[12] 1647
[13] 1648
[14] 1649
[15] 1650
[16] 1651
[17] 1652
[18] 1653
[19] 1654
[20] 1655
[21] 1656
[22] 1657
[23] 1658
[24] 1659
[25] 1660
[26] 1661
[27] 1662
[28] 1663
[29] 1664
[30] 1665
[31] 1666
[proxychains] config file found: /usr/local/Cellar/proxychains-ng/4.7/etc/proxychains.conf
[proxychains] preloading /usr/local/Cellar/proxychains-ng/4.7/lib/libproxychains4.dylib
[32] 1667
[33] 1668
[34] 1669
[35] 1670
[36] 1671
[37] 1672
[38] 1673
[39] 1674
[40] 1675
[41] 1676
[42] 1677
[43] 1678
[44] 1679
[45] 1680
[46] 1681
[47] 1682
[48] 1683
[49] 1684
[50] 1685
[51] 1686
[52] 1687
[2]   Done                    b=1026
[3]   Done                    nlh=4096
[4]   Done                    nlt=60
[5]   Done                    bf=90
[6]   Done                    p2p=1
[7]   Done                    video_type=mp4
[8]   Done                    termid=1
[9]   Done                    tss=ios
[10]   Done                    platid=2
[11]   Done                    splatid=207
[12]   Done                    its=0
[13]   Done                    qos=5
[14]   Done                    fcheck=0
[15]   Done                    amltag=59888
[16]   Done                    mltag=59888
[17]   Done                    proxy=1699055385,1699073726,467476968
[18]   Done                    uid=1698983025.rp
[19]   Done                    keyitem=GOw_33YJAAbXYE-cnQwpfLlv_b2zAkYctFVqe5bsXQpaGNn3T1-vhw..
[20]   Done                    ntm=1479966600
[21]   Done                    nkey=41e3f95f543d32d20c665c83c0f4689e
[22]   Done                    nkey2=629a08547753575bae83c59311a3f3d1
[23]   Done                    geo=CN-11-143-2
[24]   Done                    mmsid=212593520
[25]   Done                    tm=1479948543643
[26]   Done                    key=58d94f80f21d9c79333bb7c9168b1dd8
[27]   Done                    payff=0
[28]   Done                    cuid=800957
[29]   Done                    vtype=28
[30]   Done                    dur=11614
[31]   Done                    p1=3
[32]   Done                    p2=30
[33]   Done                    p3=300
[34]   Done                    cf=flash
[35]   Done                    p=101
[36]   Done                    playid=0
[37]   Done                    tag=flash
[38]   Done                    sign=bcloud_800957
[39]   Done                    pay=0
[40]   Done                    ostype=windows
[41]   Done                    hwtype=un
[42]   Done                    ctv=pc
[43]   Done                    m3v=1
[44]   Done                    ch=800957
[45]   Done                    tn=0.5598899112083018
[46]   Done                    uuid=D400F53BC9369C002A13C58B4621A4EF29028F14
[47]   Done                    vid=37387402
[48]   Done                    rateid=27
[49]   Done                    errc=0
[50]   Done                    gn=1198
[51]   Done                    vrtmcd=102
[proxychains] DLL init
[debug] System config: []
[debug] User config: []
[debug] Command-line args: [u'-v', u'http://101.69.135.251/234/42/31/bcloud/800957/ver_00_22-1072044892-avc-938269-aac-77375-11614240-1490692133-5876c859ec209c280c24ddb8dd3c87eb-1478766957606.m3u8?crypt=79aa7f2e1154']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2016.11.22
[proxychains] DLL init
[debug] Python version 2.7.9 - Darwin-14.5.0-x86_64-i386-64bit
[debug] exe versions: ffmpeg 3.0.1-tessus
[debug] Proxy map: {}
[generic] ver_00_22-1072044892-avc-938269-aac-77375-11614240-1490692133-5876c859ec209c280c24ddb8dd3c87eb-1478766957606: Requesting header
[proxychains] Strict chain  ...  127.0.0.1:1080  ...  101.69.135.251:80  ...  OK
WARNING: Could not send HEAD request to http://101.69.135.251/234/42/31/bcloud/800957/ver_00_22-1072044892-avc-938269-aac-77375-11614240-1490692133-5876c859ec209c280c24ddb8dd3c87eb-1478766957606.m3u8?crypt=79aa7f2e1154: HTTP Error 403: Forbidden
[generic] ver_00_22-1072044892-avc-938269-aac-77375-11614240-1490692133-5876c859ec209c280c24ddb8dd3c87eb-1478766957606: Downloading webpage
[proxychains] Strict chain  ...  127.0.0.1:1080  ...  101.69.135.251:80  ...  OK
ERROR: Unable to download webpage: HTTP Error 403: Forbidden (caused by HTTPError());
KwToPA commented 8 years ago

Finally I still download this video through http://m.video.caixin.com/m/2016-11-10/101006167.html on safari using html5

url is (NOW THIS LINK IS DISABLE 403 FORBIDDEN I DON NOT KNOW WHY)

http://101.69.135.251/234/42/31/bcloud/800957/ver_00_22-1072044892-avc-938269-aac-77375-11614240-1490692133-5876c859ec209c280c24ddb8dd3c87eb-1478766957606.mp4?crypt=79aa7f2e1154&b=1026&nlh=4096&nlt=60&bf=90&p2p=1&video_type=mp4&termid=2&tss=no&platid=2&splatid=206&its=0&qos=5&fcheck=0&amltag=59888&mltag=59888&proxy=467476968&uid=1698983025.rp&keyitem=GOw_33YJAAbXYE-cnQwpfLlv_b2zAkYctFVqe5bsXQpaGNn3T1-vhw..&ntm=1479969600&nkey=731c8d53ea748af5682f970018a48f6c&nkey2=785f38dcea94d5355ba261b3bade9ff5&geo=CN-11-143-2&mmsid=212593520&tm=1479951314941&key=7889004594adb6ff7aedca0063be3413&payff=0&cuid=800957&vtype=28&dur=11614&p1=3&p2=31&p3=310&cf=h5-android&p=101&playid=0&tag=mobile&sign=bcloud_800957&pay=0&ostype=android&hwtype=un&uuid=E284024A56B28CBB7B205CEC5D3CF1F5_0&vid=37387402&ajax=1&_r=jsonp&errc=0&gn=1198&vrtmcd=102&buss=59888&cips=101.68.108.113

NEW URL

http://101.69.206.190/234/42/31/bcloud/800957/ver_00_22-1072044892-avc-938269-aac-77375-11614240-1490692133-5876c859ec209c280c24ddb8dd3c87eb-1478766957606.mp4?crypt=79aa7f2e1048&b=1026&nlh=4096&nlt=60&bf=82&p2p=1&video_type=mp4&termid=2&tss=no&platid=2&splatid=206&its=0&qos=5&fcheck=0&amltag=59888&mltag=59888&proxy=22207785,1902844003,467476968&uid=2086326218.rp&keyitem=GOw_33YJAAbXYE-cnQwpfLlv_b2zAkYctFVqe5bsXQpaGNn3T1-vhw..&ntm=1480012200&nkey=c58f0c0db32ad3d6b5cfbd73f9bd6913&nkey2=5b16d893f93057b04645a4897b5c937f&geo=CN-11-140-2&mmsid=212593520&tm=1479993752609&key=998fc47ec4c5adacc140dfed9888a7ef&payff=0&cuid=800957&vtype=28&dur=11614&p1=3&p2=31&p3=310&cf=h5-android&p=101&playid=0&tag=mobile&sign=bcloud_800957&pay=0&ostype=android&hwtype=un&uuid=302E67A365907EEE808EE0AFF01A2850_0&vid=37387402&ajax=1&_r=jsonp&errc=0&gn=1105&vrtmcd=102&buss=59888&cips=124.90.207.202

BUT I STILL WANT TO KNOW HOW TO DOWNLOAD THIS VIDEO USING YOUTUBE-DL THX

yan12125 commented 8 years ago

Those are custom Letv Cloud embed players. For the given example, you can download it with:

youtube-dl -v "http://yuntv.letv.com/bcloud.html?uu=kd9ksjef36&vu=da670abc2d"

uu and vu values can be found in http://player.caixin.com/v/g/c/2016/11/10/1478766789206.json, and the latter URL is in the webpage.

KwToPA commented 8 years ago

@yan12125 does not work

 proxychains4 youtube-dl -v http://yuntv.letv.com/bcloud.html?uu=kd9ksjef36&vu=da670abc2d
[1] 749
nnnnnn:Desktop chenbruce$ [proxychains] config file found: /usr/local/Cellar/proxychains-ng/4.7/etc/proxychains.conf
[proxychains] preloading /usr/local/Cellar/proxychains-ng/4.7/lib/libproxychains4.dylib
[proxychains] DLL init
[debug] System config: []
[debug] User config: []
[debug] Command-line args: [u'-v', u'http://yuntv.letv.com/bcloud.html?uu=kd9ksjef36']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2016.11.22
[proxychains] DLL init
[debug] Python version 2.7.9 - Darwin-14.5.0-x86_64-i386-64bit
[debug] exe versions: ffmpeg 3.0.1-tessus
[debug] Proxy map: {}
ERROR: Invalid URL: http://yuntv.letv.com/bcloud.html?uu=kd9ksjef36
dstftw commented 8 years ago

https://github.com/rg3/youtube-dl#video-url-contains-an-ampersand-and-im-getting-some-strange-output-1-2839-or-v-is-not-recognized-as-an-internal-or-external-command

KwToPA commented 8 years ago

@dstftw WHAT DO U MEAN?

dstftw commented 8 years ago

Bother to read what I posted.

quark-E commented 6 years ago

I know this is an old issue, but I think it should be closed. I just tried to download another (newer) video from the site using yan12125 's instructions and the video downloaded fine.

yan12125 commented 6 years ago

This issue should be kept open as http://video.caixin.com/2016-11-10/101006167.html is still not supported.