Open GoogleCodeExporter opened 9 years ago
1.
在目前的连接复用机制上无法避免;把MultiRangeFetchEnable打开��
�有缓解
2. 某次fetch失败三次会终止整个proxy请求,失败原因在于GAE
server段过于繁忙。“Reduce fetch worker num to 1 since server is too
busy”表明尽量缓解server的压力,但超过三次后还是会失败
Original comment by yinqiwen@gmail.com
on 13 Mar 2013 at 6:49
这一版视频处理上还是有些问题,我这边碰到的比较明显的��
�个就是放youtube一段时间后,程序有一定几率会崩溃,如issue
389所述,之前版本好像很少碰到崩溃问题。
ps:已经用的是github最新的issue 389 solution版
Original comment by fifa...@gmail.com
on 13 Mar 2013 at 7:28
有没有crash时的完整输出?一般顶层的的输出代表bug所在,可
能是空指针问题
Original comment by yinqiwen@gmail.com
on 13 Mar 2013 at 8:09
目前重现步骤不明确,可以确定的是存在这个bug存在,有两��
�是youtube放了一段时间,关浏览器很久后崩溃,有一次是拖动
进度条若干次后崩溃了。
我这设置了RangeConcurrentFetcher=5,
貌似内存涨得很快,多开几个youtube很快能到200m,CPU占用也不
低
PS:发觉issue
211最后所列举的那个视频貌似我这边也是大概放2分钟就断流�
��一般较短的视频好像都还比较正常
PS 2:拖动进度条部分时候会“播放错误”
Original comment by fifa...@gmail.com
on 13 Mar 2013 at 2:54
@yinqiwen
另外發現GAE端打不開alexa.com,一直在等待,好似卡在google-anal
ytics?
2013/03/14 15:01:09 gae.go:393: Session[2118]Request GET http://www.alexa.com/
2013/03/14 15:01:10 google.go:117: Session[2119]Request GET
http://www.google-analytics.com/siteopt.js?v=1&utmxkey=0243819492&utmx=&utmxx=&u
tmxtime=1363244470067
Original comment by JayleeAm...@gmail.com
on 14 Mar 2013 at 7:09
好像以前有提过这个问题,似乎和浏览器有关。 firefox?
Original comment by yinqiwen@gmail.com
on 15 Mar 2013 at 2:02
chrome/firefox都打不開.
Original comment by JayleeAm...@gmail.com
on 15 Mar 2013 at 4:42
又崩溃了,貌似仍然跟youtube有关。
2013/03/15 13:26:27 google.go:96: Session[630]Request CONNECT
https://www.youtube.com:443
2013/03/15 13:26:29 gae.go:399: Session[636]Request GET
http://r17---sn-i3b7sn7d.c.youtube.com/videoplayback?sver=3&ratebypass=yes&ms=au
&mt=1363325174&key=yt1&ip=101.224.25.242&newshard=yes&ipbits=8&itag=43&source=yo
utube&upn=LovAuB_iEd0&mv=m&fexp=931304%2C907724%2C923126%2C914027%2C910810%2C920
704%2C912806%2C902000%2C919512%2C929901%2C913605%2C906938%2C931202%2C931401%2C90
8529%2C930803%2C920201%2C929602%2C930101%2C930603%2C900824%2C910223&sparams=cp%2
Cid%2Cip%2Cipbits%2Citag%2Cratebypass%2Csource%2Cupn%2Cexpire&expire=1363348126&
id=89b8bf263e62ac57&cp=U0hVSFNPVl9HUENONV9LSVpCOjQtZUVfbExTY3l1&cpn=0B9sxxKfsMkX
U5UI&signature=17663708632DC22F00817B1F6A2ABA97157F6977.28DD8F5F73AFC25E3787C800
7A6A0B653E64F710
2013/03/15 13:26:29 c4_http.go:141: Pull worker:0 stop working
2013/03/15 13:26:29 c4_http.go:128: Pull worker:0 start working
2013/03/15 13:26:33 c4_http.go:141: Pull worker:2 stop working
2013/03/15 13:26:33 c4_http.go:128: Pull worker:2 start working
2013/03/15 13:26:34 range.go:181: Session[636]Recv first range chunk:bytes
0-65535/60971325, 60971324 0
2013/03/15 13:26:34 range.go:341: Session[636]Fetch range:bytes=65536-327679
2013/03/15 13:26:34 range.go:341: Session[636]Fetch range:bytes=589824-851967
2013/03/15 13:26:34 range.go:341: Session[636]Fetch range:bytes=1114112-1376255
2013/03/15 13:26:34 range.go:341: Session[636]Fetch range:bytes=851968-1114111
2013/03/15 13:26:34 range.go:341: Session[636]Fetch range:bytes=327680-589823
2013/03/15 13:26:34 google.go:96: Session[637]Request CONNECT
https://i2.ytimg.com:443
2013/03/15 13:26:34 google.go:96: Session[638]Request CONNECT
https://i4.ytimg.com:443
2013/03/15 13:26:34 google.go:96: Session[639]Request CONNECT
https://i3.ytimg.com:443
2013/03/15 13:26:35 range.go:353: Session[636]Range fetch:bytes=327680-589823
redirect to
http://r17---sn-hp576m7z.c.youtube.com/videoplayback?sver=3&ratebypass=yes&ms=tc
r&mt=1363325161&key=yt1&ip=101.224.25.242&newshard=yes&ipbits=8&itag=43&source=y
outube&upn=LovAuB_iEd0&mv=m&fexp=931304%2C907724%2C923126%2C914027%2C910810%2C92
0704%2C912806%2C902000%2C919512%2C929901%2C913605%2C906938%2C931202%2C931401%2C9
08529%2C930803%2C920201%2C929602%2C930101%2C930603%2C900824%2C910223&sparams=cp%
2Cid%2Cip%2Cipbits%2Citag%2Cratebypass%2Csource%2Cupn%2Cexpire&expire=1363348126
&id=89b8bf263e62ac57&cp=U0hVSFNPVl9HUENONV9LSVpCOjQtZUVfbExTY3l1&cpn=0B9sxxKfsMk
XU5UI&signature=17663708632DC22F00817B1F6A2ABA97157F6977.28DD8F5F73AFC25E3787C80
07A6A0B653E64F710&redirect_counter=1&cms_redirect=yes
2013/03/15 13:26:35 range.go:353: Session[636]Range fetch:bytes=589824-851967
redirect to
http://r17---sn-hp576m7z.c.youtube.com/videoplayback?sver=3&ratebypass=yes&ms=tc
r&mt=1363325161&key=yt1&ip=101.224.25.242&newshard=yes&ipbits=8&itag=43&source=y
outube&upn=LovAuB_iEd0&mv=m&fexp=931304%2C907724%2C923126%2C914027%2C910810%2C92
0704%2C912806%2C902000%2C919512%2C929901%2C913605%2C906938%2C931202%2C931401%2C9
08529%2C930803%2C920201%2C929602%2C930101%2C930603%2C900824%2C910223&sparams=cp%
2Cid%2Cip%2Cipbits%2Citag%2Cratebypass%2Csource%2Cupn%2Cexpire&expire=1363348126
&id=89b8bf263e62ac57&cp=U0hVSFNPVl9HUENONV9LSVpCOjQtZUVfbExTY3l1&cpn=0B9sxxKfsMk
XU5UI&signature=17663708632DC22F00817B1F6A2ABA97157F6977.28DD8F5F73AFC25E3787C80
07A6A0B653E64F710&redirect_counter=1&cms_redirect=yes
2013/03/15 13:26:35 range.go:353: Session[636]Range fetch:bytes=851968-1114111
redirect to
http://r17---sn-hp576m7z.c.youtube.com/videoplayback?sver=3&ratebypass=yes&ms=tc
r&mt=1363325161&key=yt1&ip=101.224.25.242&newshard=yes&ipbits=8&itag=43&source=y
outube&upn=LovAuB_iEd0&mv=m&fexp=931304%2C907724%2C923126%2C914027%2C910810%2C92
0704%2C912806%2C902000%2C919512%2C929901%2C913605%2C906938%2C931202%2C931401%2C9
08529%2C930803%2C920201%2C929602%2C930101%2C930603%2C900824%2C910223&sparams=cp%
2Cid%2Cip%2Cipbits%2Citag%2Cratebypass%2Csource%2Cupn%2Cexpire&expire=1363348126
&id=89b8bf263e62ac57&cp=U0hVSFNPVl9HUENONV9LSVpCOjQtZUVfbExTY3l1&cpn=0B9sxxKfsMk
XU5UI&signature=17663708632DC22F00817B1F6A2ABA97157F6977.28DD8F5F73AFC25E3787C80
07A6A0B653E64F710&redirect_counter=1&cms_redirect=yes
2013/03/15 13:26:35 range.go:353: Session[636]Range fetch:bytes=327680-589823
redirect to
http://r5---sn-p5qlsu7l.c.youtube.com/videoplayback?sver=3&ratebypass=yes&ms=tsu
&mt=1363325163&key=yt1&ip=101.224.25.242&newshard=yes&ipbits=8&itag=43&source=yo
utube&upn=LovAuB_iEd0&mv=m&fexp=931304%2C907724%2C923126%2C914027%2C910810%2C920
704%2C912806%2C902000%2C919512%2C929901%2C913605%2C906938%2C931202%2C931401%2C90
8529%2C930803%2C920201%2C929602%2C930101%2C930603%2C900824%2C910223&sparams=cp%2
Cid%2Cip%2Cipbits%2Citag%2Cratebypass%2Csource%2Cupn%2Cexpire&expire=1363348126&
id=89b8bf263e62ac57&cp=U0hVSFNPVl9HUENONV9LSVpCOjQtZUVfbExTY3l1&cpn=0B9sxxKfsMkX
U5UI&signature=17663708632DC22F00817B1F6A2ABA97157F6977.28DD8F5F73AFC25E3787C800
7A6A0B653E64F710&cms_redirect=yes&redirect_counter=2
2013/03/15 13:26:35 gae.go:260: Failed to request data from
GAE:XXXX.appspot.com for:http: error connecting to proxy https://GoogleHttpsIP:
dial tcp X.X.X.X:443: i/o timeout
2013/03/15 13:26:36 c4_http.go:141: Pull worker:1 stop working
2013/03/15 13:26:36 c4_http.go:128: Pull worker:1 start working
2013/03/15 13:26:36 range.go:200: Session[636]Recv range chunk:bytes
65536-327679/60971325
2013/03/15 13:26:36 range.go:213: Session[636]Expect range chunk:327680
2013/03/15 13:26:36 range.go:341: Session[636]Fetch range:bytes=1376256-1638399
2013/03/15 13:26:38 range.go:200: Session[636]Recv range chunk:bytes
1114112-1376255/60971325
2013/03/15 13:26:38 range.go:213: Session[636]Expect range chunk:327680
2013/03/15 13:26:38 range.go:341: Session[636]Fetch range:bytes=1638400-1900543
2013/03/15 13:26:38 range.go:200: Session[636]Recv range chunk:bytes
327680-589823/60971325
2013/03/15 13:26:38 range.go:213: Session[636]Expect range chunk:589824
2013/03/15 13:26:38 range.go:341: Session[636]Fetch range:bytes=1900544-2162687
2013/03/15 13:26:39 range.go:353: Session[636]Range fetch:bytes=1900544-2162687
redirect to
http://r17---sn-hp576m7z.c.youtube.com/videoplayback?sver=3&ratebypass=yes&ms=tc
r&mt=1363325161&key=yt1&ip=101.224.25.242&newshard=yes&ipbits=8&itag=43&source=y
outube&upn=LovAuB_iEd0&mv=m&fexp=931304%2C907724%2C923126%2C914027%2C910810%2C92
0704%2C912806%2C902000%2C919512%2C929901%2C913605%2C906938%2C931202%2C931401%2C9
08529%2C930803%2C920201%2C929602%2C930101%2C930603%2C900824%2C910223&sparams=cp%
2Cid%2Cip%2Cipbits%2Citag%2Cratebypass%2Csource%2Cupn%2Cexpire&expire=1363348126
&id=89b8bf263e62ac57&cp=U0hVSFNPVl9HUENONV9LSVpCOjQtZUVfbExTY3l1&cpn=0B9sxxKfsMk
XU5UI&signature=17663708632DC22F00817B1F6A2ABA97157F6977.28DD8F5F73AFC25E3787C80
07A6A0B653E64F710&redirect_counter=1&cms_redirect=yes
2013/03/15 13:26:39 range.go:200: Session[636]Recv range chunk:bytes
1376256-1638399/60971325
2013/03/15 13:26:39 range.go:213: Session[636]Expect range chunk:589824
2013/03/15 13:26:39 range.go:341: Session[636]Fetch range:bytes=2162688-2424831
2013/03/15 13:26:41 range.go:200: Session[636]Recv range chunk:bytes
1638400-1900543/60971325
2013/03/15 13:26:41 range.go:213: Session[636]Expect range chunk:589824
2013/03/15 13:26:41 range.go:341: Session[636]Fetch range:bytes=2424832-2686975
2013/03/15 13:26:41 c4_http.go:141: Pull worker:0 stop working
2013/03/15 13:26:41 c4_http.go:128: Pull worker:0 start working
2013/03/15 13:26:41 range.go:353: Session[636]Range fetch:bytes=2424832-2686975
redirect to
http://r17---sn-hp576m7z.c.youtube.com/videoplayback?sver=3&ratebypass=yes&ms=tc
r&mt=1363325161&key=yt1&ip=101.224.25.242&newshard=yes&ipbits=8&itag=43&source=y
outube&upn=LovAuB_iEd0&mv=m&fexp=931304%2C907724%2C923126%2C914027%2C910810%2C92
0704%2C912806%2C902000%2C919512%2C929901%2C913605%2C906938%2C931202%2C931401%2C9
08529%2C930803%2C920201%2C929602%2C930101%2C930603%2C900824%2C910223&sparams=cp%
2Cid%2Cip%2Cipbits%2Citag%2Cratebypass%2Csource%2Cupn%2Cexpire&expire=1363348126
&id=89b8bf263e62ac57&cp=U0hVSFNPVl9HUENONV9LSVpCOjQtZUVfbExTY3l1&cpn=0B9sxxKfsMk
XU5UI&signature=17663708632DC22F00817B1F6A2ABA97157F6977.28DD8F5F73AFC25E3787C80
07A6A0B653E64F710&redirect_counter=1&cms_redirect=yes
2013/03/15 13:26:43 c4_http.go:141: Pull worker:1 stop working
2013/03/15 13:26:43 c4_http.go:128: Pull worker:1 start working
2013/03/15 13:26:44 range.go:200: Session[636]Recv range chunk:bytes
1900544-2162687/60971325
2013/03/15 13:26:44 range.go:213: Session[636]Expect range chunk:589824
2013/03/15 13:26:44 range.go:341: Session[636]Fetch range:bytes=2686976-2949119
2013/03/15 13:26:44 range.go:200: Session[636]Recv range chunk:bytes
589824-851967/60971325
2013/03/15 13:26:44 range.go:200: Session[636]Recv range chunk:bytes
851968-1114111/60971325
2013/03/15 13:26:44 range.go:213: Session[636]Expect range chunk:589824
2013/03/15 13:26:44 range.go:341: Session[636]Fetch range:bytes=2949120-3211263
2013/03/15 13:26:44 range.go:200: Session[636]Recv range chunk:bytes
2424832-2686975/60971325
2013/03/15 13:26:44 range.go:213: Session[636]Expect range chunk:589824
2013/03/15 13:28:24 hosts.go:156: Init AutoHost.
Original comment by fifa...@gmail.com
on 15 Mar 2013 at 5:34
@JayleeAm 测试了一下,果然打不开
@yinqiwen 打开alexa里面貌似有这样的log是啥意思
2013/03/15 13:44:33 gae.go:399: Session[12]Request GET http://pcache.alexa.com/j
s/ext/crazyegg.86bff008305af608f34190d64102597e.js
2013/03/15 13:44:33 gae.go:399: Session[10]Request GET http://pcache.alexa.com/j
s/Alexa.d43b928fdc2773b44a77a2d3930efa57.js
2013/03/15 13:44:33 dispatch.go:111: Session[11][WARN][GAE]Failed to request pro
xy event for reason:snappy: unsupported COPY_4 tag
2013/03/15 13:44:33 dispatch.go:147: Session[11]Process error:No proxy found for
request 'GET pcache.alexa.com' with 1 candidates for host:pcache.alexa.com
2013/03/15 13:44:33 dispatch.go:217: Session[11]Browser close connection:use of
closed network connection
2013/03/15 13:44:35 dispatch.go:111: Session[8][WARN][GAE]Failed to request prox
y event for reason:snappy: unsupported COPY_4 tag
2013/03/15 13:44:35 dispatch.go:147: Session[8]Process error:No proxy found for
request 'GET pcache.alexa.com' with 1 candidates for host:pcache.alexa.com
Original comment by fifa...@gmail.com
on 15 Mar 2013 at 5:47
@Jay 测试了下,果然打不开
@Yingqiwen 打开alexa有这样的log是什么意思?不支持snappy?
2013/03/15 13:44:33 gae.go:399: Session[12]Request GET http://pcache.alexa.com/j
s/ext/crazyegg.86bff008305af608f34190d64102597e.js
2013/03/15 13:44:33 gae.go:399: Session[10]Request GET http://pcache.alexa.com/j
s/Alexa.d43b928fdc2773b44a77a2d3930efa57.js
2013/03/15 13:44:33 dispatch.go:111: Session[11][WARN][GAE]Failed to request pro
xy event for reason:snappy: unsupported COPY_4 tag
2013/03/15 13:44:33 dispatch.go:147: Session[11]Process error:No proxy found for
request 'GET pcache.alexa.com' with 1 candidates for host:pcache.alexa.com
2013/03/15 13:44:33 dispatch.go:217: Session[11]Browser close connection:use of
closed network connection
2013/03/15 13:44:35 dispatch.go:111: Session[8][WARN][GAE]Failed to request prox
y event for reason:snappy: unsupported COPY_4 tag
2013/03/15 13:44:35 dispatch.go:147: Session[8]Process error:No proxy found for
request 'GET pcache.alexa.com' with 1 candidates for host:pcache.alexa.com
Original comment by HDhea...@gmail.com
on 15 Mar 2013 at 5:49
我这边开alexa 有这样的log 是什么意思?不支持snappy?
Original comment by fifa...@gmail.com
on 15 Mar 2013 at 5:51
Attachments:
1. crash的问题可能和并发有关,改为1应该没有这个问题
2. unsupported COPY_4 tag
大致是因为server端是java的,snappy库的实现有不一致的地方
Original comment by yinqiwen@gmail.com
on 15 Mar 2013 at 6:49
如果把终端(cygwin之类)的缓冲调大一些,
就能看到完整的crash输出了;
我看下能否重现这个问题
Original comment by yinqiwen@gmail.com
on 19 Mar 2013 at 1:48
又抓到一个,不知道是不是完整的log
Original comment by fifa...@gmail.com
on 19 Mar 2013 at 4:54
Attachments:
试下重定向错误 gsnova.exe 2 > crash.log
Original comment by yinqiwen@gmail.com
on 19 Mar 2013 at 7:12
另外还有这样一个bug:
打开某些页面firefox会显示“内容编码错误”,chrome则一片空�
��,但反复刷新几次就能打开。
比如下面这个链接http://igfw.net/archives/12429,貌似有时打开首��
�igfw.net也如此,而且不局限于该网站,比如www.plurk.com
也碰到过类似问题,
估计应该还是GAE的bug
Original comment by fifa...@gmail.com
on 19 Mar 2013 at 1:16
Attachments:
如果GAE的server端是java的话,应该和snappy压缩库实现有关,下�
��版本替换了Java的Snappy实现会减少很多由此引起的问题。
可以升级下附件的server端看看是否是这个问题(直接执行解��
�后的deply.bat按步骤部署)
Original comment by yinqiwen@gmail.com
on 19 Mar 2013 at 1:56
Attachments:
[deleted comment]
1、是java的(因go版貌似用户权限分配有bug)
2、测试了下,bug没解决,还是要刷新几次才能正常显示
Original comment by fifa...@gmail.com
on 19 Mar 2013 at 3:39
ps:
感觉是客户端的问题(不太确定哪一版开始,估计是0.20.0左��
�),之前的版本没出现过这种问题
Original comment by fifa...@gmail.com
on 19 Mar 2013 at 3:45
?
一次都未重现这个问题,我记得以前某个版本倒会有这个问��
�;你直接连48101端口看下是否是spac的问题。
Original comment by yinqiwen@gmail.com
on 20 Mar 2013 at 12:57
我这也是,今日不能重现了…………昨天反复出现
Original comment by fifa...@gmail.com
on 20 Mar 2013 at 4:29
Original issue reported on code.google.com by
JayleeAm...@gmail.com
on 13 Mar 2013 at 6:22