isunbejo / yt-cache

Automatically exported from code.google.com/p/yt-cache
0 stars 0 forks source link

video dont donload complete and delete temp #4

Open GoogleCodeExporter opened 9 years ago

GoogleCodeExporter commented 9 years ago
What steps will reproduce the problem?
1.
2.
3.

What is the expected output? What do you see instead?

What version of the product are you using? On what operating system?

Please provide any additional information below.

hi 
attach the problem

131 0   send_dynamic_headers_to_client  Custom header > client: [Cache-Control: 
public, max-age=31536000]   2012-05-01 22:12:12 1510
132 1   run Unable to cache: cache filename 
[/var/www/videos/storage3/e/e/id=e8aa3656a65c90a3.itag=34], cachable [1], 
already downloading [1], do not cache [0]   2012-05-01 22:12:12 1510
133 1   transfer_file   Beginning to transfer file content from the 
Internet    2012-05-01 22:12:12 1510
134 2   transfer_file   Empty content reached at pos [1781747] packet [1222] file 
[/var/www/videos/storage2/e/e/id=e8aa3656a65c90a3.itag=34] request 
[id=e8aa3656a65c90a3.itag=34]   2012-05-01 22:12:18 1197
135 1   close_cache_file    Closing cache file, transferred 1781747 bytes, 1222 
buffers, 0 retries  2012-05-01 22:12:18 1197
136 1   close_cache_file    Not fully downloaded [1781760/1781747]  2012-05-01 
22:12:18    1197
137 1   stop_caching    Stopping file cache, deleting file pointer and temp 
file    2012-05-01 22:12:18 1197
138 1   stop_caching    Temporary cache file deleted    2012-05-01 22:12:18 1197
139 1   close_cache_file    Closing cache file, transferred 1781747 bytes, 1222 
buffers, 0 retries  2012-05-01 22:12:18 1197
140 1   close_cache_file    URL not cached, file pointer empty  2012-05-01 
22:12:18    1197
141 1   transfer_file   File content for request id=e8aa3656a65c90a3.itag=34 fully 
transferred, 17469280 bytes

thanks

leandro

Original issue reported on code.google.com by leandros...@gmail.com on 18 May 2012 at 2:04

GoogleCodeExporter commented 9 years ago
Can you post me "Not fully downloaded" message from more than 1 video?

Original comment by dragon...@gmail.com on 26 May 2012 at 9:52

GoogleCodeExporter commented 9 years ago
    send_dynamic_headers_to_client  Custom header > client: [Cache-Control: public, max-age=31536000]   2012-05-29 09:52:48 1071
132 1   run Unable to cache: cache filename 
[/var/www/videos/storage2/b/b/id=b9d298db9ac816e9.itag=34], cachable [1], 
already downloading [1], do not cache [0]   2012-05-29 09:52:48 1071
133 1   transfer_file   Beginning to transfer file content from the 
Internet    2012-05-29 09:52:48 1071
134 2   transfer_file   Empty content reached at pos [1781747] packet [1214] file 
[/var/www/videos/storage2/b/b/id=b9d298db9ac816e9.itag=34] request 
[id=b9d298db9ac816e9.itag=34]   2012-05-29 09:52:54 1069
135 1   close_cache_file    Closing cache file, transferred 1781747 bytes, 1214 
buffers, 0 retries  2012-05-29 09:52:54 1069
136 1   close_cache_file    Not fully downloaded [1781760/1781747]  2012-05-29 
09:52:54    1069
137 1   stop_caching    Stopping file cache, deleting file pointer and temp 
file    2012-05-29 09:52:54 1069
138 1   stop_caching    Temporary cache file deleted    2012-05-29 09:52:54 1069
139 1   close_cache_file    Closing cache file, transferred 1781747 bytes, 1214 
buffers, 0 retries  2012-05-29 09:52:54 1069
140 1   close_cache_file    URL not cached, file pointer empty

Original comment by trust.wo...@live.com on 29 May 2012 at 4:57

GoogleCodeExporter commented 9 years ago
same problem here. with 9 out of 10 vidoes.

Original comment by trust.wo...@live.com on 29 May 2012 at 4:57

GoogleCodeExporter commented 9 years ago
    send_dynamic_headers_to_client  Custom header > client: [Cache-Control: public, max-age=31536000]   2012-05-29 09:59:49 1072
132 1   run Unable to cache: cache filename 
[/var/www/videos/storage2/2/2/id=26cc1fcc3298af4e.itag=34], cachable [1], 
already downloading [1], do not cache [0]   2012-05-29 09:59:49 1072
133 1   transfer_file   Beginning to transfer file content from the 
Internet    2012-05-29 09:59:49 1072
134 2   transfer_file   Empty content reached at pos [1781747] packet [1197] file 
[/var/www/videos/storage1/2/2/id=26cc1fcc3298af4e.itag=34] request 
[id=26cc1fcc3298af4e.itag=34]   2012-05-29 09:59:55 1069
135 1   close_cache_file    Closing cache file, transferred 1781747 bytes, 1197 
buffers, 0 retries  2012-05-29 09:59:55 1069
136 1   close_cache_file    Not fully downloaded [1781760/1781747]  2012-05-29 
09:59:55    1069
137 1   stop_caching    Stopping file cache, deleting file pointer and temp 
file    2012-05-29 09:59:55 1069
138 1   stop_caching    Temporary cache file deleted    2012-05-29 09:59:55 1069
139 1   close_cache_file    Closing cache file, transferred 1781747 bytes, 1197 
buffers, 0 retries

Original comment by trust.wo...@live.com on 29 May 2012 at 5:01

GoogleCodeExporter commented 9 years ago
1   2   open_cache_file Cannot open temp cache file: 
[/a/a/id=a3e0dbd539a140ef.itag=34.87771703_4fcbd5b5715c16.74839179.192.168.10.11
.tmp]   2012-06-04 02:23:01 12940
2   2   open_cache_file Cannot open temp cache file: 
[/a/a/id=a3e0dbd539a140ef.itag=34.1771381559_4fcbd5c0c9e3d6.35851259.192.168.10.
11.tmp] 2012-06-04 02:23:13 13007
3   2   connect_to_server   Reached maximum of retires (4), killing script URL: 
http://o-o.preferred.ptcl-isb1.v22.lscache3.c.youtube.com/videoplayback
upn=RGlYEN_YPh0
sparams=cp%2Cid%2Cip%2Cipbits%2Citag%2Cratebypass%2Csource%2Cupn%2Cexpire
fexp=912306%2C908618%2C907217%2C907335%2C921602%2C919306%2C919316%2C912804%2C913
542%2C919324%2C912706
ms=au
itag=18
ip=116.0.0.0
signature=73412615B261B8787B4BDA0A7618F6E7C8893847.BAFA9084209F247005A462E0B92D5
A5D8E8DF427
sver=3
mt=1338758112
ratebypass=yes
source=youtube
expire=1338783901
key=yt1
ipbits=8
cp=U0hSTVdTUV9FS0NOMl9PTVVKOjJKNXcyR3g4dUNC
id=17f9dbcdf66479b8 2012-06-04 02:23:47 13028
4   2   open_cache_file Cannot open temp cache file: 
[/1/1/id=17f9dbcdf66479b8.itag=34.111823731_4fcbd61e574184.63152599.192.168.10.1
1.tmp]  2012-06-04 02:24:46 13052
5   2   open_cache_file Cannot open temp cache file: 
[/d/d/id=de45af7a51711b50.itag=34.501102356_4fcbd64760e623.11184803.192.168.10.1
1.tmp]  2012-06-04 02:25:27 13043
6   2   open_cache_file Cannot open temp cache file: 
[/d/d/id=de45af7a51711b50.itag=18.1088558354_4fcbd661192655.78101425.192.168.10.
11.tmp] 2012-06-04 02:25:55 10592
7   2   open_cache_file Cannot open temp cache file: 
[/e/e/id=e268ed81d59debb4.itag=43.1660167164_4fcbd6a7c41ab2.84648660.192.168.10.
11.tmp] 2012-06-04 02:27:07 13118
8   2   transfer_file   Empty content reached at pos [245747] packet [131] file 
[/5/5/id=5e6f3b2d64f5dab9.itag=34] request 
[id=5e6f3b2d64f5dab9.itag=34]   2012-06-04 02:29:02 13118
9   2   open_cache_file Cannot open temp cache file: 
[/5/5/id=5e6f3b2d64f5dab9.itag=18.690417090_4fcbd72b61a821.59749016.192.168.10.1
1.tmp]  2012-06-04 02:29:16 13066
10  2   connect_to_server   Reached maximum of retires (4), killing script URL: 
http://o-o.preferred.ptcl-isb1.v1.lscache4.c.youtube.com/videoplayback
upn=29jOVK9AKlI
sparams=cp%2Cid%2Cip%2Cipbits%2Citag%2Cratebypass%2Csource%2Cupn%2Cexpire
fexp=912306%2C908618%2C907217%2C907335%2C921602%2C919306%2C919316%2C912804%2C913
542%2C919324%2C912706
ms=au
itag=18
ip=116.0.0.0
signature=C0F3B44582D2E3CA3F0D9D0748A94C180AE6CCAC.50495BE0652F1F32418934C2207C2
4DFB95B7F0F
sver=3
mt=1338758112
ratebypass=yes
source=youtube
expire=1338783568
key=yt1
ipbits=8
cp=U0hSTVdTUV9LUkNOMl9PTVVGOjlKNXcyR3g4cUlJ
id=de45af7a51711b50 2012-06-04 02:29:29 10592
11  2   open_cache_file Cannot open temp cache file: 
[/8/8/id=806c3030e12d386b.itag=34.1181705504_4fcbd778c69c00.10698788.192.168.10.
11.tmp] 2012-06-04 02:30:33 13043
12  2   open_cache_file Cannot open temp cache file: 
[/8/8/id=806c3030e12d386b.itag=34.1733753891_4fcbd77ec652b2.92063084.192.168.10.
11.tmp] 2012-06-04 02:30:38 13032
13  2   open_cache_file Cannot open temp cache file: 
[/9/9/id=90602cb884e5f603.itag=18.674113717_4fcbd7934cabf0.99026282.192.168.10.1
3.tmp]  2012-06-04 02:31:00 10592
14  2   open_cache_file Cannot open temp cache file: 
[/9/9/id=90602cb884e5f603.itag=18.1945656069_4fcbd798ee36c5.49456145.192.168.10.
13.tmp] 2012-06-04 02:31:05 13125
15  2   open_cache_file Cannot open temp cache file: 
[/8/8/id=806c3030e12d386b.itag=18.1516314353_4fcbd8437c9550.13098471.192.168.10.
11.tmp] 2012-06-04 02:33:55 13130
16  2   open_cache_file Cannot open temp cache file: 
[/e/e/id=e268ed81d59debb4.itag=43.1580134785_4fcbd89081d619.50992255.192.168.10.
11.tmp] 2012-06-04 02:35:16 13113
17  2   transfer_file   Empty content reached at pos [7180] packet [5] file 
[/5/5/id=5e6f3b2d64f5dab9.itag=18] request 
[id=5e6f3b2d64f5dab9.itag=18]   2012-06-04 02:36:09 13137
18  2   open_cache_file Cannot open temp cache file: 
[/9/9/id=9a910aebf9c996ea.itag=34.942791624_4fcbd90d64b798.92861678.192.168.10.1
1.tmp]  2012-06-04 02:37:17 13134
19  2   open_cache_file Cannot open temp cache file: 
[/9/9/id=9a910aebf9c996ea.itag=18.1001517589_4fcbd91c435413.78015800.192.168.10.
11.tmp] 2012-06-04 02:37:33 13029
20  2   transfer_file   Empty content reached at pos [156661] packet [109] file 
[/9/9/id=9a910aebf9c996ea.itag=18] request 
[id=9a910aebf9c996ea.itag=18]   2012-06-04 02:37:38 13017
21  2   transfer_file   Empty content reached at pos [204500] packet [134] file 
[/9/9/id=9a910aebf9c996ea.itag=18] request 
[id=9a910aebf9c996ea.itag=18]   2012-06-04 02:37:50 13029
22  2   transfer_file   Empty content reached at pos [153349] packet [89] file 
[/9/9/id=9a910aebf9c996ea.itag=18] request 
[id=9a910aebf9c996ea.itag=18]   2012-06-04 02:37:57 13113
23  2   transfer_file   Empty content reached at pos [96480] packet [67] file 
[/9/9/id=9a910aebf9c996ea.itag=18] request 
[id=9a910aebf9c996ea.itag=18]   2012-06-04 02:38:12 13015
24  2   transfer_file   Empty content reached at pos [488923] packet [336] file 
[/data/1/9/9/id=9a910aebf9c996ea.itag=18] request 
[id=9a910aebf9c996ea.itag=18]   2012-06-04 02:38:17 13138
25  2   transfer_file   Empty content reached at pos [38880] packet [28] file 
[/data/1/9/9/id=9a910aebf9c996ea.itag=18] request 
[id=9a910aebf9c996ea.itag=18]   2012-06-04 02:38:28 13134
26  2   transfer_file   Empty content reached at pos [257760] packet [153] file 
[/9/9/id=9a910aebf9c996ea.itag=18] request 
[id=9a910aebf9c996ea.itag=18]   2012-06-04 02:38:28 13032
27  2   open_cache_file Cannot open temp cache file: 
[/1/1/id=1ee69a39f460a457.itag=34.705290559_4fcbd95ac3ed37.50386449.192.168.10.1
1.tmp]  2012-06-04 02:38:35 13017
28  2   open_cache_file Cannot open temp cache file: 
[/1/1/id=1ee69a39f460a457.itag=34.1958284850_4fcbd9645b1912.78467926.192.168.10.
11.tmp] 2012-06-04 02:38:44 13029
29  2   transfer_file   Empty content reached at pos [656640] packet [390] file 
[/9/9/id=9a910aebf9c996ea.itag=18] request 
[id=9a910aebf9c996ea.itag=18]   2012-06-04 02:39:22 13043
30  2   transfer_file   Empty content reached at pos [685506] packet [332] file 
[/9/9/id=9a910aebf9c996ea.itag=18] request 
[id=9a910aebf9c996ea.itag=18]   2012-06-04 02:39:39 13118
31  2   open_cache_file Cannot open temp cache file: 
[/2/2/id=227dcb4bfb854ab9.itag=43.1017031519_4fcbd99cc2fd47.39886001.192.168.10.
11.tmp] 2012-06-04 02:39:41 13134
32  2   open_cache_file Cannot open temp cache file: 
[/8/8/id=8a25a8f77ba1af39.itag=18.1044209414_4fcbd9a49a5301.76577671.192.168.10.
13.tmp] 2012-06-04 02:39:49 13032
33  2   open_cache_file Cannot open temp cache file: 
[/8/8/id=8a25a8f77ba1af39.itag=18.992156696_4fcbd9a6091354.74719986.192.168.10.1
3.tmp]  2012-06-04 02:39:50 13017
34  2   open_cache_file Cannot open temp cache file: 
[/8/8/id=8a25a8f77ba1af39.itag=18.1147074170_4fcbd9abe15011.08369093.192.168.10.
13.tmp] 2012-06-04 02:39:56 13118
35  2   open_cache_file Cannot open temp cache file: 
[/e/e/id=e52a2c54827a8488.itag=34.1606812734_4fcbdb2172e8a3.19677826.192.168.10.
11.tmp] 2012-06-04 02:46:09 13125
36  2   open_cache_file Cannot open temp cache file: 
[/e/e/id=e52a2c54827a8488.itag=34.2133328091_4fcbdb2d17f554.77201349.192.168.10.
11.tmp] 2012-06-04 02:46:21 13052

Original comment by trust.wo...@live.com on 3 Jun 2012 at 9:49

GoogleCodeExporter commented 9 years ago

Version: 5.3.6-13ubuntu3.7 [ok]
OS: Linux [ok]
Debug: no
Memory limit: 128M
Expose: 
Safe mode: 
Software

 Ubuntu
Linux version: Linux version 3.0.0-12-generic-pae (buildd@vernadsky) (gcc 
version 4.6.1 (Ubuntu/Linaro 4.6.1-9ubuntu3) ) #20-Ubuntu SMP Fri Oct 7 
16:37:17 UTC 2011 
MYSQL Version: 5.1.62-0ubuntu0.11.10.1
APACHE Version: Apache

Original comment by trust.wo...@live.com on 4 Jun 2012 at 7:55

GoogleCodeExporter commented 9 years ago
[deleted comment]
GoogleCodeExporter commented 9 years ago
Did your files get created when buffering?
Is your path (i see you have few different one) is writeable by apache server?
Did you format your paths before starting cache?

Original comment by dragon...@gmail.com on 8 Jun 2012 at 8:05

GoogleCodeExporter commented 9 years ago
[deleted comment]
GoogleCodeExporter commented 9 years ago
some files created nd full downloaded but most of them stop downloadin here is 
error logs

9   2   open_cache_file Cannot open temp cache file: 
[/a/a/id=a4c235a53610d7c2.itag=34.1832612535_4fd25d86cea1d2.22670778.192.168.10.
11.tmp] 2012-06-09 01:16:07 1241
10  2   open_cache_file Cannot open temp cache file: 
[/a/a/id=a4c235a53610d7c2.itag=34.2048909561_4fd25d935ce2c7.92801220.192.168.10.
11.tmp] 2012-06-09 01:16:19 1071
11  2   transfer_file   Empty content reached at pos [1200164] packet [473] file 
[/data/1/3/3/id=3fb009b2a6911a04.itag=34] request [id=3fb009b2a6911a04.itag=34]

now i have only 1 path which is. /data/1 yes apache server can write on it here 
is logs.

X 
33  id=236ad89c670932e1.itag=18 /data/1 /data/1/2/2/id=236ad89c670932e1.itag=18 1
92.168.10.13    2012-06-03 00:55:21 16614450 (17MB) 2012-06-03 
00:55:21    1   yes Content-Type: video/mp4;Content-Length: 16614450;Last-Modified: 
Fri, 24 Jul 2009 04:44:43 GMT;Server: gvs 1.0
X 
31  id=0f39ee57eb4d5dff.itag=34 /data/1 /data/1/0/0/id=0f39ee57eb4d5dff.itag=34 1
92.168.10.11    2012-06-03 00:20:41 25964613 (26MB) 2012-06-03 
00:20:41    1   yes Content-Type: video/x-flv;Content-Length: 
25964613;Last-Modified: Thu, 07 Jan 2010 11:20:11 GMT;Server: gvs 1.0
X 
32  id=79474b52cff317a8.itag=34 /data/1 /data/1/7/7/id=79474b52cff317a8.itag=34 1
92.168.10.12    2012-06-03 00:37:37 8794083 (9MB)   2012-06-03 
00:37:37    1   yes Content-Type: video/x-flv;Content-Length: 8794083;Last-Modified: 
Tue, 13 Jul 2010 05:52:13 GMT;Server: gvs 1.0
X 
30  id=78ce69164350ee7a.itag=34 /data/1 /data/1/7/7/id=78ce69164350ee7a.itag=34 1
92.168.10.13    2012-06-03 00:17:00 4612734 (5MB)   2012-06-03 
00:17:00    1   yes Content-Type: video/x-flv;Content-Length: 4612734;Last-Modified: 
Thu, 31 May 2012 21:09:49 GMT;Server: gvs 1.0
X 
29  id=c389266ce7b172b1.itag=34 /data/1 /data/1/c/c/id=c389266ce7b172b1.itag=34 1
92.168.10.11    2012-06-03 00:06:08 4176229 (4MB)   2012-06-03 
00:06:08    3   yes Content-Type: video/x-flv;Content-Length: 4176229;Last-Modified: 
Wed, 07 Apr 2010 13:35:44 GMT;Server: gvs 1.0

yes i format it again after changing cache store.

is this problem accured becouse i changed the cache store path? coz temp cache 
file error didnt show full path its just show directories not full path like 
data/1/a/a/

Original comment by trust.wo...@live.com on 8 Jun 2012 at 8:33

GoogleCodeExporter commented 9 years ago
In your posts some of the files are in /var/www/videos/storage3, some are in /, 
and some are in /data/1 /data/1/.
Maybe files cannot be created in your path, so it's better to make it default 
under the tree of web directory like it was when you installed script.
Try to put back default path, format it and try to cache. See if the files are 
beign created when you cache it.

Original comment by dragon...@gmail.com on 11 Jun 2012 at 6:25

GoogleCodeExporter commented 9 years ago
open_cache_file Cannot open temp cache file: solved! after set all 4 paths.

now im hav another issue. i cannot access debug page. deubug value is set to 2. 
i know its becouse i played alot with file permissions. can u please help me 
with this.? thanks in advance. 

Original comment by trust.wo...@live.com on 11 Jun 2012 at 4:55

GoogleCodeExporter commented 9 years ago
Debug is taken from the DB not from the files.
Try to access your DB and empty debug table.
You can do it from mysql console by entering command:
use yourdatabase;
truncate debug;

Original comment by dragon...@gmail.com on 13 Jun 2012 at 7:05

GoogleCodeExporter commented 9 years ago
thanks its work. now i have only two types of errors in bebug.

66  2   transfer_file   Empty content reached at pos [262395] packet [179] file 
[/data/1/0/0/id=049519ce5b44a8e2.itag=34] request 
[id=049519ce5b44a8e2.itag=34]   2012-06-13 23:37:07 1304

67  2   transfer_file   Empty content reached at pos [1781747] packet [1019] file 
[/data/4/6/6/id=698689750d9f33ac.itag=34] request 
[id=698689750d9f33ac.itag=34]   2012-06-13 23:40:53 1222

68  2   connect_to_server   Reached maximum of retires (4), killing script URL: 
http://o-o.preferred.ptcl-isb1.v9.lscache1.c.youtube.com/videoplayback
upn=ZfKxnHhdqxU
sparams=cp%2Cid%2Cip%2Cipbits%2Citag%2Cratebypass%2Csource%2Cupn%2Cexpire
fexp=916004%2C904824%2C907217%2C907335%2C921602%2C919306%2C922600%2C919316%2C912
804%2C913542%2C919324%2C912706
ms=au
itag=18
ip=116.0.0.0
signature=0C83C4367E34E80940F62A90069D4DF5F3F620FF.AC88709A98C012F11BCE79406C64F
B41F10D08F2
sver=3
mt=1339612814
ratebypass=yes
source=youtube
expire=1339635710
key=yt1
ipbits=8
cp=U0hSTlZOU19GSkNOMl9OSFdIOnkyNVhidVdHVndN
id=bc1784cb5413daa6 2012-06-13 23:41:45 1077

69  2   connect_to_server   Reached maximum of retires (4), killing script URL: 
http://o-o.preferred.ptcl-isb1.v9.lscache1.c.youtube.com/videoplayback
upn=NhpuKZne79w
sparams=cp%2Cid%2Cip%2Cipbits%2Citag%2Cratebypass%2Csource%2Cupn%2Cexpire
fexp=909522%2C914045%2C901700%2C910207%2C907217%2C907335%2C921602%2C919306%2C922
600%2C919316%2C912804%2C913542%2C919324%2C912706
ms=au
itag=18
ip=116.0.0.0
signature=2387281BFF98F6BFABA99C519758188D28B0D62F.361BD27047E69ACEC6C0B496EE577
0F0606959C5
sver=3
mt=1339612814
ratebypass=yes
source=youtube
expire=1339635710
key=yt1
ipbits=8
cp=U0hSTlZOU19GSkNOMl9OSFdIOmdHaEJIOVEwUXQ2
id=bc1784cb5413daa6 2012-06-13 23:42:07 1306
____________________________________________________________

and in transfers tab there is some videos showing which not transfering but 
still there for about 3 or more days.
_______________________________________

586271  id=fa79054ca12b99cb.itag=34 /data/2/f/f/id=fa79054ca12b99cb.itag=34.11247
96497_4fd5beecb66ca3.59083823.192.168.10.11.tmp 2012-06-11 
14:48:32    54774433    260955  180 192.168.10.11   1456    0   59:42:17

917469  id=60a5604c50a7ab7e.itag=34 /data/1/6/6/id=60a5604c50a7ab7e.itag=34.10015
48292_4fd8c5b8266377.89950278.192.168.10.11.tmp 2012-06-13 
21:58:44    47969387    6528469 1890    192.168.10.11   1243    14  04:32:05

562703  id=78530b982b35f469.itag=34 /data/2/7/7/id=78530b982b35f469.itag=34.32190
4036_4fd54fa0b2f503.42978686.192.168.10.14.tmp  2012-06-11 
06:54:00    76135765    3353940 1800    192.168.10.14   5442    4   67:36:49

590897  id=793bf5bf8516b610.itag=34 /data/1/7/7/id=793bf5bf8516b610.itag=34.37980
6846_4fd5e0688411a4.63187220.192.168.10.11.tmp  2012-06-11 
17:12:08    30644597    2972022 660 192.168.10.11   1100    10  57:18:41

117840  id=8b084e5218493c15.itag=34 /data/1/8/8/id=8b084e5218493c15.itag=34.31593
887_4fcc87efd66fa8.16809061.192.168.10.11.tmp   2012-06-04 
15:05:29    6478658 450230  280 192.168.10.11   1177    7   227:25:20

117908  id=8d23a36d8c377a97.itag=34 /data/1/8/8/id=8d23a36d8c377a97.itag=34.53597
2855_4fcc886c1da746.26854404.192.168.10.11.tmp  2012-06-04 
15:05:51    1781760 1765184 680 192.168.10.11   1110    99  227:24:58

590899  id=3b7e79b202761b3b.itag=34 /data/2/3/3/id=3b7e79b202761b3b.itag=34.11175
32148_4fd5e0078c38b1.88811713.192.168.10.11.tmp 2012-06-11 
17:12:10    192044495   4544597 770 192.168.10.11   1277    2   57:18:39

590898  id=502176ea5ce5c81f.itag=34 /data/4/5/5/id=502176ea5ce5c81f.itag=34.13709
60537_4fd5e056568be3.39338186.192.168.10.11.tmp 2012-06-11 
17:12:09    34875617    4393332 1100    192.168.10.11   1311    13  57:18:40

610215  id=563b9ed2978cfb87.itag=34 /data/4/5/5/id=563b9ed2978cfb87.itag=34.10854
74028_4fd622a49748d1.53817702.192.168.10.10.tmp 2012-06-11 
21:54:02    1781747 510791  240 192.168.10.10   1081    29  52:36:47

274109  id=59bd37befec99266.itag=35 /data/2/5/5/id=59bd37befec99266.itag=35.76026
0879_4fd296aff20dd9.17255278.192.168.10.11.tmp  2012-06-09 
05:22:18    701810059   8488853 1440    192.168.10.11   1076    1   117:08:31

Original comment by trust.wo...@live.com on 13 Jun 2012 at 9:37

GoogleCodeExporter commented 9 years ago
Stalled transfers are happening becouse of improperly terminated/stuck php 
script.
This may happen becouse of some problem in php or apache, but cleanup code 
should get rid of it. I will check if the cleanup code is working.
"Reached maximum retries" means server tried to connect to youtube but 
connection is rejected, 4 times. Do you have connection problems?
"Empty packet" means server returned empty packed instead on video content and 
end of file is not reached. This check prevents zombie process that would never 
get whole video.
It would be more useful to see whole log of one failed video. You can do this 
by clicking on PID (last number) and paste me log of last connection on that 
PID. This way one video processing is shown.

Original comment by dragon...@gmail.com on 14 Jun 2012 at 8:13

GoogleCodeExporter commented 9 years ago
its temporarily solved by deleting temporary table content. 'DELETE FROM 
temporary;'
but it happened again when video transfering is in progress and server shutdown 
or rebooted.
may be i have connection problem but im sure that its not that much.
here is the complete log of Empty content reached at pos.
___________________________________________________________
1   1   get_original_url    Accessed URL 
http://o-o.preferred.ptcl-khi1.v22.lscache7.c.youtube.com/videoplayback
id=622da41f853b13c0
factor=1.25
cm2=1
expire=1339827458
ms=au
fexp=907721%2C919303%2C910101%2C907217%2C907335%2C921602%2C919306%2C922600%2C919
316%2C920704%2C912804%2C913542%2C919324%2C912706
sver=3
algorithm=throttle-factor
mt=1339802115
ip=116.0.0.0
signature=C1B448124CAA442487B9416AF20F242DAED063E4.56C03EB888FB623BFFCE27089DBAE
0A7FDF7E1E9
source=youtube
itag=34
ipbits=8
keepalive=yes
range=13-1781759
burst=40
key=yt1
cp=U0hSTlhNVV9KUkNOMl9QR1lFOllJaEZBLUg3Vm5h
upn=C3CzjoINdj4
sparams=algorithm%2Cburst%2Ccp%2Cfactor%2Cid%2Cip%2Cipbits%2Citag%2Csource%2Cupn
%2Cexpire   2012-06-16 04:17:05 1261
2   0   produce_cache_filename  Cache: cache filename 
[/data/4/6/6/id=622da41f853b13c0.itag=34], temp 
[/data/4/6/6/id=622da41f853b13c0.itag=34.1586988821_4fdbc271e47e56.40700310.192.
168.10.6.tmp]   2012-06-16 04:17:05 1261
3   0   get_client_request_headers  $_SERVER[HTTP_HOST] => 
[o-o.preferred.ptcl-khi1.v22.lscache7.c.youtube.com]    2012-06-16 04:17:05 1261
4   0   get_client_request_headers  copy client header [Host] => 
[o-o.preferred.ptcl-khi1.v22.lscache7.c.youtube.com]    2012-06-16 04:17:05 1261
5   0   get_client_request_headers  $_SERVER[HTTP_USER_AGENT] => [Mozilla/5.0 
(Windows NT 6.1; WOW64; rv:12.0) Gecko/20100101 Firefox/12.0]   2012-06-16 
04:17:05    1261
6   0   get_client_request_headers  copy client header [User-Agent] => [Mozilla/5.0 
(Windows NT 6.1; WOW64; rv:12.0) Gecko/20100101 Firefox/12.0]   2012-06-16 
04:17:05    1261
7   0   get_client_request_headers  $_SERVER[HTTP_ACCEPT] => 
[text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8]   2012-06-16 
04:17:05    1261
8   0   get_client_request_headers  copy client header [Accept] => 
[text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8]   2012-06-16 
04:17:05    1261
9   0   get_client_request_headers  $_SERVER[HTTP_ACCEPT_LANGUAGE] => 
[en-us,en;q=0.5]    2012-06-16 04:17:05 1261
10  0   get_client_request_headers  copy client header [Accept-Language] => 
[en-us,en;q=0.5]    2012-06-16 04:17:05 1261
11  0   get_client_request_headers  $_SERVER[HTTP_ACCEPT_ENCODING] => [gzip, 
deflate]    2012-06-16 04:17:05 1261
12  0   get_client_request_headers  copy client header [Accept-Encoding] => [gzip, 
deflate]    2012-06-16 04:17:05 1261
13  0   get_client_request_headers  $_SERVER[HTTP_COOKIE] => 
[VISITOR_INFO1_LIVE=ULiGV-J2Vmw; PREF=fv=11.3.300; 
use_hitbox=d5c5516c3379125f43aa0d495d100d6ddAEAAAAw; 
recently_watched_video_id_list=c1a4cdc974bec6fc248f4edb7cda631cWwEAAABzCwAAAFlpM
mtINFU3RThB; ACTIVITY=1339802220772]    2012-06-16 04:17:05 1261
14  0   get_client_request_headers  copy client header [Cookie] => 
[VISITOR_INFO1_LIVE=ULiGV-J2Vmw; PREF=fv=11.3.300; 
use_hitbox=d5c5516c3379125f43aa0d495d100d6ddAEAAAAw; 
recently_watched_video_id_list=c1a4cdc974bec6fc248f4edb7cda631cWwEAAABzCwAAAFlpM
mtINFU3RThB; ACTIVITY=1339802220772]    2012-06-16 04:17:05 1261
15  0   get_client_request_headers  $_SERVER[HTTP_VIA] => [1.1 localhost 
(squid/3.1.19)] 2012-06-16 04:17:05 1261
16  0   get_client_request_headers  copy client header [Via] => [1.1 localhost 
(squid/3.1.19)] 2012-06-16 04:17:05 1261
17  0   get_client_request_headers  $_SERVER[HTTP_X_FORWARDED_FOR] => 
[192.168.10.6]  2012-06-16 04:17:05 1261
18  0   get_client_request_headers  copy client header [X-Forwarded-For] => 
[192.168.10.6]  2012-06-16 04:17:05 1261
19  0   get_client_request_headers  $_SERVER[HTTP_CACHE_CONTROL] => 
[max-age=0] 2012-06-16 04:17:05 1261
20  0   get_client_request_headers  copy client header [Cache-Control] => 
[max-age=0] 2012-06-16 04:17:05 1261
21  0   get_client_request_headers  $_SERVER[HTTP_CONNECTION] => 
[keep-alive]    2012-06-16 04:17:05 1261
22  0   get_client_request_headers  copy client header [Connection] => 
[keep-alive]    2012-06-16 04:17:05 1261
23  0   get_client_request_headers  $_SERVER[PATH] => 
[/usr/local/bin:/usr/bin:/bin]  2012-06-16 04:17:05 1261
24  0   get_client_request_headers  $_SERVER[SERVER_SIGNATURE] => [
Apache Server at o-o.preferred.ptcl-khi1.v22.lscache7.c.youtube.com Port 80
]   2012-06-16 04:17:05 1261
25  0   get_client_request_headers  $_SERVER[SERVER_SOFTWARE] => 
[Apache]    2012-06-16 04:17:05 1261
26  0   get_client_request_headers  $_SERVER[SERVER_NAME] => 
[o-o.preferred.ptcl-khi1.v22.lscache7.c.youtube.com]    2012-06-16 04:17:05 1261
27  0   get_client_request_headers  $_SERVER[SERVER_ADDR] => [127.0.0.1]    2012-06-16 
04:17:05    1261
28  0   get_client_request_headers  $_SERVER[SERVER_PORT] => [80]   2012-06-16 
04:17:05    1261
29  0   get_client_request_headers  $_SERVER[REMOTE_ADDR] => [127.0.0.1]    2012-06-16 
04:17:05    1261
30  0   get_client_request_headers  $_SERVER[DOCUMENT_ROOT] => 
[/var/www]  2012-06-16 04:17:05 1261
31  0   get_client_request_headers  $_SERVER[SERVER_ADMIN] => 
[webmaster@localhost]   2012-06-16 04:17:05 1261
32  0   get_client_request_headers  $_SERVER[SCRIPT_FILENAME] => 
[/var/www/youtube.php]  2012-06-16 04:17:05 1261
33  0   get_client_request_headers  $_SERVER[REMOTE_PORT] => [55406]    2012-06-16 
04:17:05    1261
34  0   get_client_request_headers  $_SERVER[GATEWAY_INTERFACE] => 
[CGI/1.1]   2012-06-16 04:17:05 1261
35  0   get_client_request_headers  $_SERVER[SERVER_PROTOCOL] => 
[HTTP/1.1]  2012-06-16 04:17:05 1261
36  0   get_client_request_headers  $_SERVER[REQUEST_METHOD] => [GET]   2012-06-16 
04:17:05    1261
37  0   get_client_request_headers  $_SERVER[QUERY_STRING] => 
[url=aHR0cDovL28tby5wcmVmZXJyZWQucHRjbC1raGkxLnYyMi5sc2NhY2hlNy5jLnlvdXR1YmUuY29
tL3ZpZGVvcGxheWJhY2s/aWQ9NjIyZGE0MWY4NTNiMTNjMCZmYWN0b3I9MS4yNSZjbTI9MSZleHBpcmU
9MTMzOTgyNzQ1OCZtcz1hdSZmZXhwPTkwNzcyMSUyQzkxOTMwMyUyQzkxMDEwMSUyQzkwNzIxNyUyQzk
wNzMzNSUyQzkyMTYwMiUyQzkxOTMwNiUyQzkyMjYwMCUyQzkxOTMxNiUyQzkyMDcwNCUyQzkxMjgwNCU
yQzkxMzU0MiUyQzkxOTMyNCUyQzkxMjcwNiZzdmVyPTMmYWxnb3JpdGhtPXRocm90dGxlLWZhY3RvciZ
tdD0xMzM5ODAyMTE1JmlwPTExNi4wLjAuMCZzaWduYXR1cmU9QzFCNDQ4MTI0Q0FBNDQyNDg3Qjk0MTZ
BRjIwRjI0MkRBRUQwNjNFNC41NkMwM0VCODg4RkI2MjNCRkZDRTI3MDg5REJBRTBBN0ZERjdFMUU5JnN
vdXJjZT15b3V0dWJlJml0YWc9MzQmaXBiaXRzPTgma2VlcGFsaXZlPXllcyZyYW5nZT0xMy0xNzgxNzU
5JmJ1cnN0PTQwJmtleT15dDEmY3A9VTBoU1RsaE5WVjlLVWtOT01sOVFSMWxGT2xsSmFFWkJMVWczVm0
1aCZ1cG49QzNDempvSU5kajQmc3BhcmFtcz1hbGdvcml0aG0lMkNidXJzdCUyQ2NwJTJDZmFjdG9yJTJ
DaWQlMkNpcCUyQ2lwYml0cyUyQ2l0YWclMkNzb3VyY2UlMkN1cG4lMkNleHBpcmU=]  2012-06-16 
04:17:05    1261
38  0   get_client_request_headers  $_SERVER[REQUEST_URI] => [/youtube.php
url=aHR0cDovL28tby5wcmVmZXJyZWQucHRjbC1raGkxLnYyMi5sc2NhY2hlNy5jLnlvdXR1YmUuY29t
L3ZpZGVvcGxheWJhY2s/aWQ9NjIyZGE0MWY4NTNiMTNjMCZmYWN0b3I9MS4yNSZjbTI9MSZleHBpcmU9
MTMzOTgyNzQ1OCZtcz1hdSZmZXhwPTkwNzcyMSUyQzkxOTMwMyUyQzkxMDEwMSUyQzkwNzIxNyUyQzkw
NzMzNSUyQzkyMTYwMiUyQzkxOTMwNiUyQzkyMjYwMCUyQzkxOTMxNiUyQzkyMDcwNCUyQzkxMjgwNCUy
QzkxMzU0MiUyQzkxOTMyNCUyQzkxMjcwNiZzdmVyPTMmYWxnb3JpdGhtPXRocm90dGxlLWZhY3RvciZt
dD0xMzM5ODAyMTE1JmlwPTExNi4wLjAuMCZzaWduYXR1cmU9QzFCNDQ4MTI0Q0FBNDQyNDg3Qjk0MTZB
RjIwRjI0MkRBRUQwNjNFNC41NkMwM0VCODg4RkI2MjNCRkZDRTI3MDg5REJBRTBBN0ZERjdFMUU5JnNv
dXJjZT15b3V0dWJlJml0YWc9MzQmaXBiaXRzPTgma2VlcGFsaXZlPXllcyZyYW5nZT0xMy0xNzgxNzU5
JmJ1cnN0PTQwJmtleT15dDEmY3A9VTBoU1RsaE5WVjlLVWtOT01sOVFSMWxGT2xsSmFFWkJMVWczVm01
aCZ1cG49QzNDempvSU5kajQmc3BhcmFtcz1hbGdvcml0aG0lMkNidXJzdCUyQ2NwJTJDZmFjdG9yJTJD
aWQlMkNpcCUyQ2lwYml0cyUyQ2l0YWclMkNzb3VyY2UlMkN1cG4lMkNleHBpcmU=]   2012-06-16 
04:17:05    1261
39  0   get_client_request_headers  $_SERVER[SCRIPT_NAME] => 
[/youtube.php]  2012-06-16 04:17:05 1261
40  0   get_client_request_headers  $_SERVER[PHP_SELF] => [/youtube.php]    2012-06-16 
04:17:05    1261
41  0   get_client_request_headers  $_SERVER[REQUEST_TIME] => 
[1339802225]    2012-06-16 04:17:05 1261
42  0   connect_to_server   Request header > server: [Host: 
o-o.preferred.ptcl-khi1.v22.lscache7.c.youtube.com] 2012-06-16 04:17:05 1261
43  0   connect_to_server   Request header > server: [Cookie: 
VISITOR_INFO1_LIVE=ULiGV-J2Vmw; PREF=fv=11.3.300; 
use_hitbox=d5c5516c3379125f43aa0d495d100d6ddAEAAAAw; 
recently_watched_video_id_list=c1a4cdc974bec6fc248f4edb7cda631cWwEAAABzCwAAAFlpM
mtINFU3RThB; ACTIVITY=1339802220772]    2012-06-16 04:17:05 1261
44  0   connect_to_server   Custom header > server: [User-Agent: YouTube 
Cache]  2012-06-16 04:17:05 1261
45  0   connect_to_server   Custom header > server: [X-Cache-Admin: 
admin@gromnet.net]  2012-06-16 04:17:05 1261
46  0   get_server_reply_headers    Server reply [HTTP/1.1 200 OK]  2012-06-16 
04:17:06    1261
47  0   get_server_reply_headers    server_reply_headers[Last-Modified] = [Wed, 13 
Jun 2012 18:56:34 GMT]  2012-06-16 04:17:06 1261
48  0   get_server_reply_headers    server_reply_headers[Content-Type] = 
[video/x-flv]   2012-06-16 04:17:06 1261
49  0   get_server_reply_headers    server_reply_headers[Date] = [Fri, 15 Jun 2012 
23:17:06 GMT]   2012-06-16 04:17:06 1261
50  0   get_server_reply_headers    server_reply_headers[Expires] = [Fri, 15 Jun 2012 
23:17:06 GMT]   2012-06-16 04:17:06 1261
51  0   get_server_reply_headers    server_reply_headers[Cache-Control] = [private, 
max-age=24932]  2012-06-16 04:17:06 1261
52  0   get_server_reply_headers    server_reply_headers[Accept-Ranges] = 
[bytes] 2012-06-16 04:17:06 1261
53  0   get_server_reply_headers    server_reply_headers[Content-Length] = 
[1781747]   2012-06-16 04:17:06 1261
54  0   get_server_reply_headers    server_reply_headers[Connection] = 
[keep-alive]    2012-06-16 04:17:06 1261
55  0   get_server_reply_headers    server_reply_headers[X-Content-Type-Options] = 
[nosniff]   2012-06-16 04:17:06 1261
56  0   get_server_reply_headers    server_reply_headers[Server] = [gvs 
1.0]    2012-06-16 04:17:06 1261
57  1   exists_in_cache Cache file with request id=622da41f853b13c0.itag=34 not 
found in db!    2012-06-16 04:17:06 1261
58  0   send_reply_headers_to_client    Reply header > client [Last-Modified: Wed, 13 
Jun 2012 18:56:34 GMT]  2012-06-16 04:17:06 1261
59  0   send_reply_headers_to_client    Reply header > client [Content-Type: 
video/x-flv]    2012-06-16 04:17:06 1261
60  0   send_reply_headers_to_client    Reply header > client [Content-Length: 
1781747]    2012-06-16 04:17:06 1261
61  0   send_reply_headers_to_client    Reply header > client [Server: gvs 
1.0]    2012-06-16 04:17:06 1261
62  0   send_dynamic_headers_to_client  Custom header > client: [Date: Fri, 15 Jun 
2012 23:17:06 GMT]  2012-06-16 04:17:06 1261
63  0   send_dynamic_headers_to_client  Custom header > client: [Expires: Sat, 15 
Jun 2013 23:17:06 GMT]  2012-06-16 04:17:06 1261
64  0   send_dynamic_headers_to_client  Custom header > client: [Cache-Control: 
public, max-age=31536000]   2012-06-16 04:17:06 1261
65  1   open_cache_file Temporary cache file 
[/data/4/6/6/id=622da41f853b13c0.itag=34.1586988821_4fdbc271e47e56.40700310.192.
168.10.6.tmp] opened for writing    2012-06-16 04:17:06 1261
66  1   transfer_file   Beginning to transfer file content from the 
Internet    2012-06-16 04:17:06 1261
67  1   transfer_file   Fixing header   2012-06-16 04:17:06 1261
134 2   transfer_file   Empty content reached at pos [1781747] packet [1209] file 
[/data/4/6/6/id=622da41f853b13c0.itag=34] request 
[id=622da41f853b13c0.itag=34]   2012-06-16 04:17:22 1261
135 1   close_cache_file    Closing cache file, transferred 1781747 bytes, 1209 
buffers, 0 retries  2012-06-16 04:17:22 1261
136 1   close_cache_file    Not fully downloaded [1781760/1781747]  2012-06-16 
04:17:22    1261
137 1   stop_caching    Stopping file cache, deleting file pointer and temp 
file    2012-06-16 04:17:22 1261
138 1   stop_caching    Temporary cache file deleted    2012-06-16 04:17:22 1261
139 1   close_cache_file    Closing cache file, transferred 1781747 bytes, 1209 
buffers, 0 retries  2012-06-16 04:17:22 1261
140 1   close_cache_file    URL not cached, file pointer empty

Original comment by trust.wo...@live.com on 16 Jun 2012 at 12:14

GoogleCodeExporter commented 9 years ago
one more thing i wana let u know that i have 1,415 videos cached. but in video 
page i see only videos which is fit in single page. theres no option to see all 
the video. may be if u place a button for next page or page1 page2 or something 
like that will be help full coz when i press checked all videos there is some 
video which [not recognized] and i want to delete them from cache. : )

Original comment by trust.wo...@live.com on 16 Jun 2012 at 12:24

GoogleCodeExporter commented 9 years ago
"Not recognized" does not always mean bad video file. It is just unrecognizable 
format.
I will add pagination to video page (and probalby search).
Right now i am working on problem with 1.5mb file transfer.

Original comment by dragon...@gmail.com on 6 Jul 2012 at 8:24