google-code-export / get-flash-videos

Automatically exported from code.google.com/p/get-flash-videos
1 stars 0 forks source link

hulu ERROR: RTMP_Connect1, handshake failed. #243

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago
What steps will reproduce the problem?
get_flash_videos 
'http://www.hulu.com/watch/82934/fullmetal-alchemist-brotherhood-the-beasts-of-d
ublith#x-4,cSubtitled,6,0'

What is the expected output? What do you see instead?
see attached file for error

What version of the product are you using? On what operating system?
get_flash_videos version 1.24
rtmpdump 2.3
linux 2.6.37

Please provide any additional information below.
Was dling video when it stopped prematurely. Have not been able to dl since. My 
guess is that's when they made some limelight changes. I tried with limelight 
off and still can not dl. (See second attached file.)

Original issue reported on code.google.com by ascula...@gmail.com on 26 Feb 2011 at 5:30

Attachments:

GoogleCodeExporter commented 9 years ago
Seems odd and intermittent.  I get this error for some videos, but not for 
others.  

For example, I get this error for these: (from 69.28.151.58 and 69.28.151.59)
http://www.hulu.com/watch/23324/wired-science-technology-world-war-20
http://www.hulu.com/watch/23323/wired-science-earth-flotsam-found

But this downloads just fine: (from 208.111.153.30)
http://www.hulu.com/watch/23330/wired-science-physics-and-chemistry-ball-busters

Using rtmpdump 2.3 on Widows XP using Cygwin Perl.

Original comment by gd2s...@gmail.com on 6 Mar 2011 at 4:29

GoogleCodeExporter commented 9 years ago
[deleted comment]
GoogleCodeExporter commented 9 years ago
More information and explanation (from the XBMC forums):
http://bit.ly/fFyoi0

Limelight resolves its individual CDN hostnames to different IP addresses 
depending on where you live, which in turn is resolved based on your DNS 
servers.

A similar process to how they block non-USA visitors from Hulu and non-UK 
visitors from BBC, but I suspect Limelight's "where are you based on DNS" rules 
are misconfigured somehow.

To see an example of it in action, visit the OpenDNS CacheCheck page and type 
in a domain name of hulu-059.fcod.llnwd.net (taken from OP's error output):
http://bit.ly/13JUBD

Use a rotating DNS list and populate the list with addresses of DNS servers 
from different parts of the USA. With enough variety in resolved IPs (from 
different DNS servers) you'll eventually hit a Limelight IP that doesn't block 
you based on assumed location.

If no luck at first, use nslookup with the DNS servers in your list to ensure a 
given Limelight CDN hostname actually is resolving to multiple IPs.

Original comment by html...@gmail.com on 7 Mar 2011 at 10:06

GoogleCodeExporter commented 9 years ago
So that link was extremely informative. I modified the plugin to try to 
download from limelight, level3, and akamai. All three failed in the way the 
submitter described. I also used OpenDNS and used their CacheCheck tool to 
reset the cache, then tried with Google's DNS and with Comcast's. All end in 
the same way. Something else seems odd

Original comment by gesquive on 16 Mar 2011 at 1:52

GoogleCodeExporter commented 9 years ago
[deleted comment]
GoogleCodeExporter commented 9 years ago
Looks like this handshake gap is widening as other content site are switching 
to it: hulu, fox, ...

http://lists.mplayerhq.hu/pipermail/rtmpdump/2011-March/001304.html
http://lists.mplayerhq.hu/pipermail/rtmpdump/2011-March/001308.html
http://lists.mplayerhq.hu/pipermail/rtmpdump/2011-March/001312.html
http://lists.mplayerhq.hu/pipermail/rtmpdump/2011-March/001313.html

Looks like it may be awhile before we get these sites back.

Original comment by pcwal...@comcast.net on 16 Mar 2011 at 5:55

GoogleCodeExporter commented 9 years ago
Looks like youtube is now using the same handhake that bis breaking rtmpdump

http://lists.mplayerhq.hu/pipermail/rtmpdump/2011-March/001329.html

Original comment by pcwal...@comcast.net on 22 Mar 2011 at 1:07

GoogleCodeExporter commented 9 years ago
Appears to be fixed after this patch:
http://lists.mplayerhq.hu/pipermail/rtmpdump/2011-March/001332.html
Built rtmpdump from svn and am getting friendly handshakes again.

Original comment by ava...@yahoo.com on 24 Mar 2011 at 1:52

GoogleCodeExporter commented 9 years ago
I built rtmpdump from the latest and tried it. I agree the handshake failure is 
gone but now there is something else blocking the download.

rtmpdump: DEBUG: HandShake: Calculated digest key from secure key and server 
digest: 
f2
DEBUG: 1b c5 67 42 0f a3 14 d4 67 3a 50 7e af 9a 17 9d
DEBUG: HandShake: Client signature calculated:
DEBUG: 15 88 43 18 7c 5e 61 4a 1b 04 f9 58 1e 80 2d a1
DEBUG: 2f f0 c9 1b 45 7c 46 95 3d 49 d8 ed d5 b1 33 62
rtmpdump: DEBUG: HandShake: Server sent signature:
rtmpdump: DEBUG: dc 5d 8e ec cd f2 9d f2 07 08 9f 67 5c d7 4d aa
rtmpdump: DEBUG: HandShake: Digest key: 
 6c 25 ae 42
DEBUG: HandShake: Signature calculated:
DEBUG: 71 6f ae 6f 3e 49 08 4a 04 31 d6 56 2e f7 a7 75
DEBUG: dc 5d 8e ec cd f2 9d f2 07 08 9f 67 5c d7 4d aa
DEBUG: HandShake: Genuine Adobe Flash Media Server
DEBUG: HandShake: Handshaking finished....
DEBUG: RTMP_Connect1, handshaked
rtmpdump: DEBUG: Invoking connect
rtmpdump: DEBUG: RTMP_ClientPacket, received: invoke 165 bytes
rtmpdump: DEBUG: (object begin)
UG: Property: <Name:               code, STRING:    NetConnection.Connect.Rejected>
DEBUG: Property: <Name:        description, STRING: Connection failed.>
DEBUG: Property: <Name:        description, STRING: [ Server.Reject ] : 
Connection failed.>
DEBUG: (object end)
DEBUG: (object end)
DEBUG: HandleInvoke, server invoking <_error>
ERROR: rtmp server sent error
DEBUG: RTMP_ClientPacket, received: invoke 18 bytes
DEBUG: (object begin)
DEBUG: Property: NULL
DEBUG: (object end)
DEBUG: HandleInvoke, server invoking <close>
ERROR: rtmp server requested close
rtmpdump: DEBUG: Closing connection.
Download failed, no valid file downloaded
Couldn't download any videos.

Original comment by pcwal...@comcast.net on 24 Mar 2011 at 7:34

GoogleCodeExporter commented 9 years ago
The latest RTMP subversion source fixes these problems.
The problem was totally upstream.

Original comment by mjbauer95 on 17 May 2011 at 2:16

GoogleCodeExporter commented 9 years ago
Issue 206 has been merged into this issue.

Original comment by mjbauer95 on 17 May 2011 at 2:19

GoogleCodeExporter commented 9 years ago
I just downloaded and built the latest rtmpdump. I checked for updates on 
get_flash_videos and hulu.pm, but I now get a new error:

Error: encrypt: datasize not multiple of blocksize (16 bytes) at 
/loader/0x9f890a8/FlashVideo/Site/Hulu.pm line 456.

Here is a debug log:

$ get_flash_videos -d 
http://www.hulu.com/watch/242236/the-morning-after-tue-may-17-2011
1 plugin installed:
- Hulu.pm
Downloading http://www.hulu.com/watch/242236/the-morning-after-tue-may-17-2011
-> GET http://www.hulu.com/watch/242236/the-morning-after-tue-may-17-2011
<- 200 text/html; charset=utf-8 (183801)
Trying to open plugin ~/.get_flash_videos/plugins/Www.pm
Trying to open plugin ~/.get_flash_videos/plugins/Hulu.pm
Using method 'hulu' for 
http://www.hulu.com/watch/242236/the-morning-after-tue-may-17-2011
Found Hulu CID: 50149457
Returning cached Hulu data
-> GET http://r.hulu.com/videos?content_id=50149457
<- 200 application/xml; charset=utf-8 (7801)
Found Hulu encrypted PID: NO_MORE_RELEASES_PLEASE_50149457
Decrypted Hulu PID: 'NO_MORE_RELEASES_PLEASE_50149457'
Auth: 9577be6c75e3771aec09e76773ab8bed
Hulu SMIL URL: 
http://s.hulu.com/select.ashx?pid=NO_MORE_RELEASES_PLEASE_50149457&auth=9577be6c
75e3771aec09e76773ab8bed&v=713434170&np=1
-> GET 
http://s.hulu.com/select.ashx?pid=NO_MORE_RELEASES_PLEASE_50149457&auth=9577be6c
75e3771aec09e76773ab8bed&v=713434170&np=1
<- 400 text/html (210)
Encrypted XML: '<html>
<head>
<title>400 Bad Request</title>
</head>
<body>
    <h2>400 Bad Request</h2>
    <p>pid 'NO_MORE_RELEASES_PLEASE_50149457' does not map to asset id</p>
    <pre id="traceback"></pre>
</body>
</html>'
XML decrypt key: 
4878B22E76379B55C962B18DDBC188D82299F8F52E3E698D0FAF29A40ED64B21, IV: 
WA7hap7AGUkevuth
Error: encrypt: datasize not multiple of blocksize (16 bytes) at 
/loader/0x9f890a8/FlashVideo/Site/Hulu.pm line 456.

Couldn't extract Flash movie URL. This site may need specific support adding,
or fixing.

Please confirm the site is using Flash video and if you have Flash available
check that the URL really works(!).

Check for updates by running: /home/pwalden/bin/get_flash_videos --update

If the latest version does not support this please open a bug (or
contribute a patch!) at http://code.google.com/p/get-flash-videos/
make sure you include the output with --debug enabled.
Couldn't download any videos.

Original comment by pcwal...@comcast.net on 17 May 2011 at 4:01

GoogleCodeExporter commented 9 years ago
Issue 263 has been merged into this issue.

Original comment by mjbauer95 on 17 May 2011 at 8:34

GoogleCodeExporter commented 9 years ago
@pcwal
Your right but I believe that is a case of issue 249.
But, I believe the above problem has been fixed.

Original comment by mjbauer95 on 17 May 2011 at 8:41