search

flowhella / get-flash-videos

Automatically exported from code.google.com/p/get-flash-videos
0 stars 0 forks source link

Daily Show Full Episode Downloads Broken #240

Open GoogleCodeExporter opened 8 years ago

GoogleCodeExporter commented 8 years ago 
What steps will reproduce the problem?

get_flash_videos 
http://www.thedailyshow.com/full-episodes/wed-february-16-2011-brian-williams

Downloading 
http://www.thedailyshow.com/full-episodes/wed-february-16-2011-brian-williams
Using method 'mtvnservices' for 
http://btg.mtvnservices.com/aria/coda.html?site=thedailyshow.com
Error: Can't use an undefined value as a HASH reference at 
/usr/local/bin/get_flash_videos line 13609.

Couldn't extract Flash movie URL. This site may need specific support adding,
or fixing.

Please confirm the site is using Flash video and if you have Flash available
check that the URL really works(!).

Check for updates by running: /usr/local/bin/get_flash_videos --update

If the latest version does not support this please open a bug (or
contribute a patch!) at http://code.google.com/p/get-flash-videos/
make sure you include the output with --debug enabled.
Couldn't download any videos.

What is the expected output? What do you see instead?

Expectation is that it will download, as it has before :)

What version of the product are you using? On what operating system?

1.2.4, os x 10.6

Please provide any additional information below.

Looks like something changed which broke the full episode handler.

Original issue reported on code.google.com by enigma.t...@gmail.com on 18 Feb 2011 at 6:32

GoogleCodeExporter commented 8 years ago 
This seems to fix the specific issue vis both feeds and full episodes on 
thedailyshow/colbertreport etc, but I'm not sure if it breaks anything in the 
general case.

Original comment by ava...@yahoo.com on 24 Feb 2011 at 5:19

Attachments:

GoogleCodeExporter commented 8 years ago 
I have verified this works.

Original comment by enigma.t...@gmail.com on 26 Feb 2011 at 7:37

GoogleCodeExporter commented 8 years ago 
Added aval57's patches to git.

Original comment by mjbauer95 on 6 Mar 2011 at 9:50

GoogleCodeExporter commented 8 years ago 
The Colbert Report full episodes haven't been working, even with the patch as 
posted or with a git clone from yesterday.  It's the mediagen error that's been 
reported elsewhere.

Windows XP Home SP3, ActivePerl 5.12.2 Build 1202, get-flash-videos 1.25-dev 
(freshly cloned less than 10 minutes ago)

gfv --debug -f output.flv "http://www.colbertnation.c
om/full-episodes/tue-march-1-2011-evan-osnos"
~1~ ~p~l~u~g~i~n~ ~i~n~s~t~a~l~l~e~d~:~
~~-~ ~H~u~l~u~.~p~m~
~Downloading http://www.colbertnation.com/full-episodes/tue-march-1-2011-evan-os
nos
-> GET http://www.colbertnation.com/full-episodes/tue-march-1-2011-evan-osnos
<- 200 text/html (44550): UTF8 off, ASCII, 44550 characters 44550 bytes
Trying to open plugin C:\Documents and Settings\Stephen\Application Data/get_fla
sh_videos/plugins/Www.pm
Trying to open plugin C:\Documents and Settings\Stephen\Application Data/get_fla
sh_videos/plugins/Colbertnation.pm
Trying to open plugin C:\Documents and Settings\Stephen\Application Data/get_fla
sh_videos/plugins/Com.pm
Trying to open plugin C:\Documents and Settings\Stephen\Application Data/get_fla
sh_videos/plugins/Media.pm
Trying to open plugin C:\Documents and Settings\Stephen\Application Data/get_fla
sh_videos/plugins/Mtvnservices.pm
Using method 'mtvnservices' for http://media.mtvnservices.com/player/scripts/mtv
n_player_loadtime.js
-> GET http://media.mtvnservices.com/mgid:cms:episode:colbertnation.com:375920
<- 302 text/html (153): UTF8 off, ASCII, 153 characters 153 bytes
-> GET http://media.mtvnservices.com/pmt/e1/players/mgid:cms:episode:colbertnati
on.com:/context6/config.xml?uri=mgid:cms:episode:colbertnation.com:375920&type=n
etwork&ref=www.colbertnation.com&geo=US&group=entertainment&
<- 200 application/xml (2698): UTF8 off, ASCII, 2698 characters 2698 bytes
-> GET http://shadow.comedycentral.com/feeds/video_player/mrss/?uri=mgid:cms:epi
sode:colbertnation.com:375920
<- 200 text/xml;charset=utf-8 (13539): UTF8 on, ASCII, 13539 characters 13539 by
tes
Error: Unable to find mediagen URL

Couldn't extract Flash movie URL. This site may need specific support adding,
or fixing.

Please confirm the site is using Flash video and if you have Flash available
check that the URL really works(!).

Check for updates by running: C:\dap\BT\get-flash-videos\gfv.pl --update

If the latest version does not support this please open a bug (or
contribute a patch!) at http://code.google.com/p/get-flash-videos/
make sure you include the output with --debug enabled.
Couldn't download any videos.

Original comment by dissentn...@gmail.com on 11 Mar 2011 at 12:17

GoogleCodeExporter commented 8 years ago 
A patch against my patched version above (since it's already added to git). 
Colbert works again for me now.

Original comment by ava...@yahoo.com on 14 Mar 2011 at 4:44

GoogleCodeExporter commented 8 years ago 
Previous patch revised slightly to accommodate some older feeds/episodes.  The 
brand-new feeds are throwing 'ERROR: RTMP_Connect1, handshake failed' in 
rtmpdump, though, which is also being seen elswhere:

https://code.google.com/p/get-flash-videos/issues/detail?id=243

Original comment by ava...@yahoo.com on 17 Mar 2011 at 4:19

Attachments:

GoogleCodeExporter commented 8 years ago 
Yet another patch against git.  This fixes:
- "not well-formed (invalid token)" error from XML::Simple on latest 
feeds/episodes.
- "Undefined subroutine &FlashVideo::Site::Mtvnservices::can_handle" error.
  (mjbauer95: the last git commit cleaned things up nicely but inadvertently deleted one line, see hunk 4 of this patch).

Good news on rtmpdumps 'Handshake 9' bug too:
https://code.google.com/p/get-flash-videos/issues/detail?id=243

Original comment by ava...@yahoo.com on 24 Mar 2011 at 4:32

Attachments:

GoogleCodeExporter commented 8 years ago 
This patch adjusts the parsing of mediagen ids slightly so as not to fail on 
encountering ampersands.

Original comment by ava...@yahoo.com on 14 Apr 2011 at 10:14

Attachments:

GoogleCodeExporter commented 8 years ago 
I believe this is fixed unless aval has some more patches up his sleeve.

Original comment by mjbauer95 on 17 May 2011 at 3:22

GoogleCodeExporter commented 8 years ago 
'Fixed' is a little too optimistic in this line of work, alas. This patch 
adjusts for the recent proliferation of ads in colbertnation feeds, causing 
problems in locating the actual clip.  There's another possible bug too, will 
post if I learn anything useful.

Original comment by ava...@yahoo.com on 4 Jun 2011 at 1:20

Attachments:

GoogleCodeExporter commented 8 years ago 
Well, the original issue has been fixed but as long as you keep giving me 
patches I'll keep applying them to git.

Original comment by mjbauer95 on 4 Jun 2011 at 10:37

GoogleCodeExporter commented 8 years ago 
thanks mjbauer95, simpler to continue updating here unless you'd really prefer 
to open a separate issue for every patch.  Broadly speaking they're all in the 
same category I think.

Original comment by ava...@yahoo.com on 6 Jun 2011 at 2:13

GoogleCodeExporter commented 8 years ago 
Issue 378 has been merged into this issue.

Original comment by mjbauer95 on 15 Apr 2012 at 10:47

GoogleCodeExporter commented 8 years ago 
current git doesn't work on colbertnation.

get_flash_videos 
http://www.colbertnation.com/the-colbert-report-videos/215454/january-08-2009/la
wrence-lessig

produces:

Not loading FlashVideo::Site::Channel4 Can't locate Crypt/Blowfish_PP.pm in 
@INC (you may need to install the Crypt::Blowfish_PP module) (@INC contains: 
CODE(0x22ba808) /usr/bin/lib /usr/lib/perl5/site_perl 
/usr/share/perl5/site_perl /usr/lib/perl5/vendor_perl 
/usr/share/perl5/vendor_perl /usr/lib/perl5/core_perl 
/usr/share/perl5/core_perl .) at 
/usr/lib/perl5/site_perl/FlashVideo/Site/Channel4.pm line 8.
BEGIN failed--compilation aborted at 
/usr/lib/perl5/site_perl/FlashVideo/Site/Channel4.pm line 8.
Compilation failed in require at (eval 104) line 2.

Not loading FlashVideo::Site::Sockshare Can't locate HTML/Tree.pm in @INC (you 
may need to install the HTML::Tree module) (@INC contains: CODE(0x22ba808) 
/usr/bin/lib /usr/lib/perl5/site_perl /usr/share/perl5/site_perl 
/usr/lib/perl5/vendor_perl /usr/share/perl5/vendor_perl 
/usr/lib/perl5/core_perl /usr/share/perl5/core_perl .) at 
/usr/lib/perl5/site_perl/FlashVideo/Site/Putlocker.pm line 6.
BEGIN failed--compilation aborted at 
/usr/lib/perl5/site_perl/FlashVideo/Site/Putlocker.pm line 6.
Compilation failed in require at (eval 178) line 2.
    ...propagated at /usr/share/perl5/core_perl/base.pm line 84.
BEGIN failed--compilation aborted at 
/usr/lib/perl5/site_perl/FlashVideo/Site/Sockshare.pm line 5.
Compilation failed in require at (eval 177) line 2.

Not loading FlashVideo::Site::Putlocker Attempt to reload 
FlashVideo/Site/Putlocker.pm aborted.
Compilation failed in require at (eval 179) line 2.

Using method 'generic' plugin version 0.01 for 
http://www.colbertnation.com/the-colbert-report-videos/215454/january-08-2009/la
wrence-lessig
Downloading 
http://www.colbertnation.com/the-colbert-report-videos/215454/january-08-2009/la
wrence-lessig
Error: No URLs found at /usr/lib/perl5/site_perl/FlashVideo/Generic.pm line 150.

Couldn't extract Flash movie URL. This site may need specific support adding,
or fixing.

Please confirm the site is using Flash video and if you have Flash available
check that the URL really works(!).

Check for updates by running: /usr/bin/get_flash_videos --update

If the latest version does not support this please open a bug
at http://code.google.com/p/get-flash-videos/ making sure you include
the output with --debug enabled. Alternatively, fix it yourself and send us
a pull request on Github: https://github.com/monsieurvideo/get-flash-videos
Couldn't download any videos.

Original comment by qubodup on 26 Jun 2013 at 11:04

GoogleCodeExporter commented 8 years ago 
My report might be unrelated. Unfortunately I have no clue how to install a 
perl package on Arch Linux that his not packaged (blowfish_bb seems to be 
needed). So I tried the latest downloadable:

$ ./combined-get_flash_videos-1.24-git-20130307 
http://www.colbertnation.com/the-colbert-report-videos/215454/januaryget_flash_v
ideos
Using method 'generic' for 
http://www.colbertnation.com/the-colbert-report-videos/215454/januaryget_flash_v
ideos
Downloading 
http://www.colbertnation.com/the-colbert-report-videos/215454/januaryget_flash_v
ideos
Error: No URLs found at ./combined-get_flash_videos-1.24-git-20130307 line 
24998.

Couldn't extract Flash movie URL. This site may need specific support adding,
or fixing.

Original comment by qubodup on 26 Jun 2013 at 11:13

GoogleCodeExporter commented 8 years ago 
Seems like this is the only thread dealing with The Daily Show issues, and I 
didn't want to open yet another one, even though this one is a bit old, so I'll 
report my issue here:

Whenever I try to download videos from thedailyshow.com I get one of the 
following error messages:

1) Full episode

---
$ get_flash_videos 
http://www.thedailyshow.com/full-episodes/tue-march-11-2014-andrew-napolitano 
--debug
No plugins installed
Trying to open plugin ~/.get_flash_videos/plugins/Www.pm
Trying to open plugin ~/.get_flash_videos/plugins/Thedailyshow.pm
Trying to open plugin ~/.get_flash_videos/plugins/Com.pm
Trying to open plugin ~/.get_flash_videos/plugins/Brightcove.pm
-> GET 
http://www.thedailyshow.com/full-episodes/tue-march-11-2014-andrew-napolitano
<- 200 text/html (170574): UTF8 off, ASCII, 170574 characters 170574 bytes
Trying to open plugin ~/.get_flash_videos/plugins/Mtvnservices.pm
-> GET 
http://www.thedailyshow.com/full-episodes/tue-march-11-2014-andrew-napolitano
<- 200 text/html (170574): UTF8 off, ASCII, 170574 characters 170574 bytes
Using method 'mtvnservices' for 
http://www.thedailyshow.com/full-episodes/tue-march-11-2014-andrew-napolitano
Downloading 
http://www.thedailyshow.com/full-episodes/tue-march-11-2014-andrew-napolitano
-> GET 
http://www.thedailyshow.com/full-episodes/tue-march-11-2014-andrew-napolitano
<- 200 text/html (170574): UTF8 off, ASCII, 170574 characters 170574 bytes
-> GET http://media.mtvnservices.com/mgid:cms:content:thedailyshow.com:934
<- 302 text/html (153): UTF8 off, ASCII, 153 characters 153 bytes
Error: No config_url/id found

Couldn't extract Flash movie URL. This site may need specific support adding,
or fixing.

Please confirm the site is using Flash video and if you have Flash available
check that the URL really works(!).

Check for updates by running: /usr/bin/get_flash_videos --update

If the latest version does not support this please open a bug (or
contribute a patch!) at http://code.google.com/p/get-flash-videos/
make sure you include the output with --debug enabled.
Couldn't download any videos.
---

2) Videos

$ get_flash_videos 
http://www.thedailyshow.com/watch/tue-march-11-2014/crimea--we-hardly-knew-ye 
--debug
No plugins installed
Trying to open plugin ~/.get_flash_videos/plugins/Www.pm
Trying to open plugin ~/.get_flash_videos/plugins/Thedailyshow.pm
Trying to open plugin ~/.get_flash_videos/plugins/Com.pm
Trying to open plugin ~/.get_flash_videos/plugins/Brightcove.pm
-> GET 
http://www.thedailyshow.com/watch/tue-march-11-2014/crimea--we-hardly-knew-ye
<- 200 text/html (87422): UTF8 off, ASCII, 87422 characters 87422 bytes
Trying to open plugin ~/.get_flash_videos/plugins/Mtvnservices.pm
-> GET 
http://www.thedailyshow.com/watch/tue-march-11-2014/crimea--we-hardly-knew-ye
<- 200 text/html (87422): UTF8 off, ASCII, 87422 characters 87422 bytes
Using method 'mtvnservices' for 
http://www.thedailyshow.com/watch/tue-march-11-2014/crimea--we-hardly-knew-ye
Downloading 
http://www.thedailyshow.com/watch/tue-march-11-2014/crimea--we-hardly-knew-ye
-> GET 
http://www.thedailyshow.com/watch/tue-march-11-2014/crimea--we-hardly-knew-ye
<- 200 text/html (87422): UTF8 off, ASCII, 87422 characters 87422 bytes
-> GET http://media.mtvnservices.com/mgid:cms:video:thedailyshow.com:433664
<- 302 text/html (153): UTF8 off, ASCII, 153 characters 153 bytes
-> GET 
http://media.mtvnservices.com/pmt/e1/players/mgid:cms:video:thedailyshow.com:/co
ntext12/config.xml?uri=mgid:cms:video:thedailyshow.com:433664&type=network&ref=w
ww.thedailyshow.com&geo=AT&group=entertainment&network=dsl&device=Other
<- 200 application/xml (2740): UTF8 off, ASCII, 2740 characters 2740 bytes
-> GET 
http://shadow.comedycentral.com/feeds/video_player/mrss/?uri=mgid:cms:video:thed
ailyshow.com:433664

<- 200 text/xml;charset=utf-8 (3884): UTF8 on, ASCII, 3884 characters 3884 bytes
Handling clip
-> GET 
http://www.cc.com/feeds/mediagen/kramer?uri=mgid:cms:video:thedailyshow.com:4336
64&device={device}
<- 200 text/xml;charset=utf-8 (2961): UTF8 on, ASCII, 2961 characters 2961 bytes
-> GET 
http://media.mtvnservices.com/http://www.cc.com/feeds/mediagen/kramer?uri=mgid:c
ms:video:thedailyshow.com:433664&device={device}
<- 404 text/html; charset=iso-8859-1 (236): UTF8 off, ASCII, 236 characters 236 
bytes
FlashVideo::RTMPDownloader=HASH(0xaa5f938)
Running rtmpdump --swfUrl 
'http://media.mtvnservices.com/http://www.cc.com/feeds/mediagen/kramer?uri=mgid:
cms:video:thedailyshow.com:433664&device={device}' --pageUrl 
'http://www.thedailyshow.com/watch/tue-march-11-2014/crimea--we-hardly-knew-ye' 
--swfsize '8' --flv 'Crimea,_We_Hardly_Knew_Ye.flv' --swfhash 
'3d20e8cb53e1828f4a0d482c0f8d8604a530536632761ce1d40cb34c38fc3082' --verbose 
--rtmp 
'rtmpe://cp9950.edgefcs.net/ondemand/mtvnorigin/gsp.comedystor/com/dailyshow/TDS
/season_19/episode_076/ds_19076_01_1280x720_3500_h32.mp4'
RTMPDump v2.4
(c) 2010 Andrej Stepanchuk, Howard Chu, The Flvstreamer Team; license: GPL
rtmpdump: DEBUG: Parsing...
rtmpdump: DEBUG: Parsed protocol: 2
BUG: Hostname : cp9950.edgefcs.net
DEBUG: Port     : 1935
DEBUG: Playpath : 
mp4:mtvnorigin/gsp.comedystor/com/dailyshow/TDS/season_19/episode_076/ds_19076_0
1_1280x720_3500_h32
DEBUG: tcUrl    : rtmpe://cp9950.edgefcs.net:1935/ondemand
DEBUG: swfUrl   : 
http://media.mtvnservices.com/http://www.cc.com/feeds/mediagen/kramer?uri=mgid:c
ms:video:thedailyshow.com:433664&device={device}
DEBUG: pageUrl  : 
http://www.thedailyshow.com/watch/tue-march-11-2014/crimea--we-hardly-knew-ye
DEBUG: app      : ondemand
DEBUG: live     : no
DEBUG: timeout  : 30 sec
DEBUG: SWFSHA256:
DEBUG: 3d 20 e8 cb 53 e1 82 8f 4a 0d 48 2c 0f 8d 86 04
DEBUG: a5 30 53 66 32 76 1c e1 d4 0c b3 4c 38 fc 30 82
DEBUG: SWFSize  : 8
DEBUG: Setting buffer time to: 36000000ms
Connecting ...
rtmpdump: DEBUG: RTMP_Connect1, ... connected, handshaking
rtmpdump: DEBUG: HandShake: Client digest offset: 1383
rtmpdump: DEBUG: HandShake: Initial client digest: 
82 6e c2 16 c9 94 4b 35
rtmpdump: DEBUG: HandShake: Type Answer   : 09
rtmpdump: DEBUG: HandShake: Server Uptime : 668949087
rtmpdump: DEBUG: HandShake: Server DH public key offset: 407
rtmpdump: DEBUG: HandShake: Secret key: 
rtmpdump: DEBUG: 48 90 57 40 36 74 00 62 aa 1d f2 f7 69 41 d5 ed
 16 c9 2a b2 e9 9e ba aa 52 06 50 50
DEBUG: a5 0c a2 2d 33 86 70 dd 36 f9 8c aa be 7f df ff
DEBUG: e5 c7 7c 1a 63 3a a8 b6 fd e7 b1 4d 5e ab e8 19
DEBUG: 90 da b5 3d 44 64 db 01 b9 ea 97 ef f0 7b f9 9b
DEBUG: 5e e7 44 1f b8 48 94 0d e7 75 3a 74 e9 a5 ce cf
DEBUG: 49 f4 79 46 f4 81 93 c1 c4 d6 58 00 e9 1c 7c d4
DEBUG: RC4 Out Key: 
rtmpdump: DEBUG: 1a 32 2a 3e fb a2 18 4a 27 75 9e 61 61 4a b2 57
rtmpdump: DEBUG: RC4 In Key: 
rtmpdump: DEBUG: ce ce 6b 69 44 53 99 08 44 70 27 f2 bd cc 3a fd
rtmpdump: DEBUG: HandShake: Calculated digest key from secure key and server 
digest: 
rtmpdump: DEBUG: 5b 07 f1 a3 2f 36 6f cd 56 ec 7b 7c 4f 37 a1 21
rtmpdump: DEBUG: HandShake: Client signature calculated:
rtmpdump: DEBUG: ab 3e 1b f0 10 10 21 9e 8d 88 bb ce d4 65 fc 4a
rtmpdump: DEBUG: HandShake: Server sent signature:
rtmpdump: DEBUG: 07 fc 14 2c ff 34 8c f4 e7 d9 c1 02 16 7c 14 30
rtmpdump: DEBUG: HandShake: Digest key: 
rtmpdump: DEBUG: 35 85 62 71 05 c5 6b b3 8c 04 26 85 e7 7a d6 8b
rtmpdump: DEBUG: HandShake: Signature calculated:
rtmpdump: DEBUG: 07 fc 14 2c ff 34 8c f4 e7 d9 c1 02 16 7c 14 30
Genuine Adobe Flash Media Server
rtmpdump: DEBUG: HandShake: Handshaking finished....
rtmpdump: DEBUG: Invoking connect
INFO: Connected...
rtmpdump: DEBUG: HandleChangeChunkSize, received: chunk size change to 128
rtmpdump: DEBUG: RTMP_ClientPacket, received: invoke 165 bytes
operty: <Name:              level, STRING:  error>
DEBUG: Property: <Name:               code, 
STRING: NetConnection.Connect.Rejected>
DEBUG: Property: <Name:        description, STRING: Connection failed.>
DEBUG: Property: <Name:        description, STRING: [ Server.Reject ] : 
Connection failed.>
DEBUG: (object end)
DEBUG: (object end)
DEBUG: HandleInvoke, server invoking <_error>
rtmpdump: ERROR: rtmp server sent error
BUG: (object end)
DEBUG: HandleInvoke, server invoking <close>
ERROR: rtmp server requested close
rtmpdump: DEBUG: Closing connection.
Download failed, no valid file downloaded
Couldn't download any videos.
---

Original comment by mitter...@gmail.com on 12 Mar 2014 at 3:46