search

bettermanbao / openwrt-kcptun

openwrt-kcptun is mips32 port of kcptun
https://github.com/xtaci/kcptun
249 stars 44 forks source link

client_linux_mips 启动正常，shadowsocks链接时崩溃 #26

Open huan opened 7 years ago

huan commented 7 years ago

版本：

配置：

$ cat /var/etc/kcptun/client.json 
{
  "localaddr": "127.0.0.1:8388",
  "remoteaddr": "139.x.x.x:554",
  "key": "key",
  "crypt": "salsa20",
  "mode": "fast",
  "nocomp": false,
  "log": "/tmp/kcptun/kcptun-client.log"
}

启动正常，但是shadowsocks链接到kcptun端口后，出错退出。试过了几乎所有的Release版本，都存在同样问题。

日志如下：

2017/03/02 03:11:59 main.go:64: stream opened
panic: runtime error: slice bounds out of range

goroutine 13 [running]:
github.com/golang/snappy.encodeBlock(0x105c0014, 0x12ac8, 0x12ac8, 0x105a8000, 0x232, 0x10000, 0x7faf41a)
    /opt/mipsgo/src/github.com/golang/snappy/encode_other.go:175 +0x10c4
github.com/golang/snappy.Encode(0x105c0012, 0x12aca, 0x12aca, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
    /opt/mipsgo/src/github.com/golang/snappy/encode.go:37 +0x370
github.com/golang/snappy.(*Writer).write(0x1053c810, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
    /opt/mipsgo/src/github.com/golang/snappy/encode.go:229 +0x280
github.com/golang/snappy.(*Writer).Flush(0x1053c810, 0x0, 0x0)
    /opt/mipsgo/src/github.com/golang/snappy/encode.go:272 +0xb0
main.(*compStream).Write(0x10538300, 0x1060a000, 0x232, 0x10008, 0x232, 0x0, 0x0)
    /home/openwrt/kcptun/client/main.go:42 +0x88
github.com/xtaci/smux.(*Session).sendLoop(0x10510190)
    /opt/mipsgo/src/github.com/xtaci/smux/session.go:302 +0x588
created by github.com/xtaci/smux.newSession
    /opt/mipsgo/src/github.com/xtaci/smux/session.go:73 +0x394

goroutine 1 [IO wait]:
net.(*pollDesc).Wait(0x10532138, 0x72, 0x0, 0x0)
    /opt/mipsgo/src/net/fd_poll_runtime.go:84 +0x4c
net.(*pollDesc).WaitRead(0x10532138, 0x0, 0x0)
    /opt/mipsgo/src/net/fd_poll_runtime.go:89 +0x48
net.(*netFD).accept(0x10532100, 0x0, 0x77dffa68, 0x10649d70)
    /opt/mipsgo/src/net/fd_unix.go:419 +0x3dc
net.(*TCPListener).AcceptTCP(0x1051c2a8, 0x77e01350, 0x0, 0x0)
    /opt/mipsgo/src/net/tcpsock_posix.go:234 +0x58
main.func·005(0x10500a00, 0x0, 0x0)
    /home/openwrt/kcptun/client/main.go:404 +0x2acc
reflect.Value.call(0x234760, 0x2e0c94, 0x13, 0x28aae0, 0x4, 0x10529a50, 0x1, 0x1, 0x0, 0x0, ...)
    /opt/mipsgo/src/reflect/value.go:419 +0xff0
reflect.Value.Call(0x234760, 0x2e0c94, 0x13, 0x10529a50, 0x1, 0x1, 0x0, 0x0, 0x0)
    /opt/mipsgo/src/reflect/value.go:296 +0xb0
github.com/urfave/cli.HandleAction(0x234760, 0x2e0c94, 0x10500a00, 0x0, 0x0)
    /opt/mipsgo/src/github.com/urfave/cli/app.go:487 +0x27c
github.com/urfave/cli.(*App).Run(0x10568000, 0x1050a000, 0x3, 0x3, 0x0, 0x0)
    /opt/mipsgo/src/github.com/urfave/cli/app.go:245 +0x9e0
main.main()
    /home/openwrt/kcptun/client/main.go:428 +0x1660

goroutine 5 [syscall]:
os/signal.loop()
    /opt/mipsgo/src/os/signal/signal_unix.go:21 +0x30
created by os/signal.init·1
    /opt/mipsgo/src/os/signal/signal_unix.go:27 +0x58

goroutine 6 [chan receive]:
main.sigHandler()
    /home/openwrt/kcptun/client/signal.go:23 +0x150
created by main.init·1
    /home/openwrt/kcptun/client/signal.go:15 +0x48

goroutine 7 [select]:
github.com/xtaci/kcp-go.(*UDPSession).updateTask(0x10562100)
    /opt/mipsgo/src/github.com/xtaci/kcp-go/sess.go:502 +0x3c4
created by github.com/xtaci/kcp-go.newUDPSession
    /opt/mipsgo/src/github.com/xtaci/kcp-go/sess.go:118 +0x4c0

goroutine 8 [select]:
github.com/xtaci/kcp-go.(*UDPSession).outputTask(0x10562100)
    /opt/mipsgo/src/github.com/xtaci/kcp-go/sess.go:408 +0x1a24
created by github.com/xtaci/kcp-go.newUDPSession
    /opt/mipsgo/src/github.com/xtaci/kcp-go/sess.go:119 +0x4f0

goroutine 9 [select]:
github.com/xtaci/kcp-go.(*UDPSession).readLoop(0x10562100)
    /opt/mipsgo/src/github.com/xtaci/kcp-go/sess.go:640 +0x50c
created by github.com/xtaci/kcp-go.newUDPSession
    /opt/mipsgo/src/github.com/xtaci/kcp-go/sess.go:121 +0x530

goroutine 11 [IO wait]:
net.(*pollDesc).Wait(0x10532cf8, 0x72, 0x0, 0x0)
    /opt/mipsgo/src/net/fd_poll_runtime.go:84 +0x4c
net.(*pollDesc).WaitRead(0x10532cf8, 0x0, 0x0)
    /opt/mipsgo/src/net/fd_poll_runtime.go:89 +0x48
net.(*netFD).readFrom(0x10532cc0, 0x1057e800, 0x800, 0x800, 0x0, 0x0, 0x0, 0x77dffa68, 0x10649678)
    /opt/mipsgo/src/net/fd_unix.go:269 +0x418
net.(*UDPConn).ReadFromUDP(0x1051c3c8, 0x1057e800, 0x800, 0x800, 0x0, 0x0, 0x0, 0x0)
    /opt/mipsgo/src/net/udpsock_posix.go:67 +0x108
net.(*UDPConn).ReadFrom(0x1051c3c8, 0x1057e800, 0x800, 0x800, 0x0, 0x0, 0x0, 0x0, 0x0)
    /opt/mipsgo/src/net/udpsock_posix.go:82 +0x104
github.com/xtaci/kcp-go.(*UDPSession).receiver(0x10562100, 0x10532080)
    /opt/mipsgo/src/github.com/xtaci/kcp-go/sess.go:621 +0x108
created by github.com/xtaci/kcp-go.(*UDPSession).readLoop
    /opt/mipsgo/src/github.com/xtaci/kcp-go/sess.go:637 +0x84

goroutine 12 [select]:
github.com/xtaci/kcp-go.(*UDPSession).Read(0x10562100, 0x105e4000, 0x4, 0x12ace, 0x8, 0x0, 0x0)
    /opt/mipsgo/src/github.com/xtaci/kcp-go/sess.go:182 +0x8d0
io.ReadAtLeast(0x77e011e0, 0x10562100, 0x105e4000, 0x4, 0x12ace, 0x4, 0x0, 0x0, 0x0)
    /opt/mipsgo/src/io/io.go:298 +0x118
io.ReadFull(0x77e011e0, 0x10562100, 0x105e4000, 0x4, 0x12ace, 0x10558400, 0x0, 0x0)
    /opt/mipsgo/src/io/io.go:316 +0x6c
github.com/golang/snappy.(*Reader).readFull(0x10532140, 0x105e4000, 0x4, 0x12ace, 0x1500e60, 0x10290bc)
    /opt/mipsgo/src/github.com/golang/snappy/decode.go:108 +0x6c
github.com/golang/snappy.(*Reader).Read(0x10532140, 0x105f8000, 0x8, 0x10008, 0x77e012d8, 0x0, 0x0)
    /opt/mipsgo/src/github.com/golang/snappy/decode.go:128 +0x1bc
main.(*compStream).Read(0x10538300, 0x105f8000, 0x8, 0x10008, 0x0, 0x0, 0x0)
    /home/openwrt/kcptun/client/main.go:37 +0x5c
io.ReadAtLeast(0x77e012d8, 0x10538300, 0x105f8000, 0x8, 0x10008, 0x8, 0x0, 0x0, 0x0)
    /opt/mipsgo/src/io/io.go:298 +0x118
io.ReadFull(0x77e012d8, 0x10538300, 0x105f8000, 0x8, 0x10008, 0x8, 0x0, 0x0)
    /opt/mipsgo/src/io/io.go:316 +0x6c
github.com/xtaci/smux.(*Session).readFrame(0x10510190, 0x105f8000, 0x10008, 0x10008, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
    /opt/mipsgo/src/github.com/xtaci/smux/session.go:189 +0x104
github.com/xtaci/smux.(*Session).recvLoop(0x10510190)
    /opt/mipsgo/src/github.com/xtaci/smux/session.go:224 +0x1d8
created by github.com/xtaci/smux.newSession
    /opt/mipsgo/src/github.com/xtaci/smux/session.go:72 +0x368

goroutine 14 [select]:
github.com/xtaci/smux.(*Session).keepalive(0x10510190)
    /opt/mipsgo/src/github.com/xtaci/smux/session.go:272 +0x360
created by github.com/xtaci/smux.newSession
    /opt/mipsgo/src/github.com/xtaci/smux/session.go:74 +0x3c0

goroutine 15 [select]:
main.scavenger(0x105322c0, 0x258)
    /home/openwrt/kcptun/client/main.go:441 +0x818
created by main.func·005
    /home/openwrt/kcptun/client/main.go:400 +0x2a6c

goroutine 17 [select]:
main.handleClient(0x10510190, 0x77e01350, 0x1051c2a0)
    /home/openwrt/kcptun/client/main.go:77 +0x688
created by main.func·005
    /home/openwrt/kcptun/client/main.go:424 +0x33c0

goroutine 18 [select]:
github.com/xtaci/smux.(*Stream).Read(0x1053a090, 0x10624000, 0x8000, 0x8000, 0x0, 0x77dfb9c0, 0x1051c068)
    /opt/mipsgo/src/github.com/xtaci/smux/stream.go:75 +0x6a8
io.Copy(0x77e013d0, 0x1051c2e0, 0x77e01370, 0x1053a090, 0x0, 0x0, 0x0, 0x0)
    /opt/mipsgo/src/io/io.go:362 +0x208
net.genericReadFrom(0x77e01388, 0x1051c2a0, 0x77e01370, 0x1053a090, 0x0, 0x0, 0x0, 0x0)
    /opt/mipsgo/src/net/net.go:404 +0xb4
net.(*TCPConn).ReadFrom(0x1051c2a0, 0x77e01370, 0x1053a090, 0x77e013b8, 0x1051c2a0, 0x0, 0x0)
    /opt/mipsgo/src/net/tcpsock_posix.go:72 +0x118
io.Copy(0x77e01388, 0x1051c2a0, 0x77e01370, 0x1053a090, 0x0, 0x0, 0x0, 0x0)
    /opt/mipsgo/src/io/io.go:358 +0x154
main.func·001()
    /home/openwrt/kcptun/client/main.go:71 +0xf8
created by main.handleClient
    /home/openwrt/kcptun/client/main.go:71 +0x474

goroutine 19 [select]:
github.com/xtaci/smux.(*Stream).Write(0x1053a090, 0x1062c000, 0x22a, 0x8000, 0x0, 0x0, 0x0)
    /opt/mipsgo/src/github.com/xtaci/smux/stream.go:116 +0x6c0
io.Copy(0x77e01400, 0x1053a090, 0x77e01418, 0x1051c2a0, 0x0, 0x0, 0x0, 0x0)
    /opt/mipsgo/src/io/io.go:364 +0x288
main.func·002()
    /home/openwrt/kcptun/client/main.go:74 +0xf8
created by main.handleClient
    /home/openwrt/kcptun/client/main.go:74 +0x5a4
PrinnyK commented 7 years ago

@zixia 服务器和客户端均禁用压缩试试，"nocomp":true，我通过这个办法解决了，感觉是路由器性能太弱导致的，另外我这边加速效果还不如shadowsocks裸连，vps用的是版瓦工

huan commented 7 years ago

@PrinnyK 非常感谢。设置 nocomp 后的确不出现数组越界错误了。但是OpenWrt内置的shadowsocks-libev链接成功后却没有调通。kcptun好像没问题了，因为我用ubuntu链接openwrt的kcptun端口已经能用了。

BTW: 后来我发现Google的TCP BBR能够有类似的效果 http://www.cnvultr.com/416.html ，目前切到BBR了，可以避免低端硬件的OpenWrt跑流量到5Mbps左右时，kcptun cpu占用100%的问题。（使用salsa20 crypt；设置为none后整体只能够再快50%左右）

PrinnyK commented 7 years ago

@zixia 老哥稳，托你的福，版瓦工上了bbr油管速度提升至4Mbps，附上OpenVZ开bbr的方法，不过需注意的是该方法违反了版瓦工TOS

huan commented 7 years ago

我现在直接在电脑上用 kcptun ，能到40Mbps，哈哈。不过 openwrt 还是没有搞定，你可以分享一下你的具体安装包下载地址，以及openwrt的shadowsocks及kcptun的配置详情（文件）吗？

PrinnyK commented 7 years ago
huan commented 7 years ago

哇，好多信息。我现在用的是一个低端的 DIR505，有点是小巧。回头我换个路由器试试。

BTW 一直有一个疑问我没弄明白，请教一下：ShadowsocksR 与 Shadowsocks 有什么区别？

PrinnyK commented 7 years ago

@zixia

huan commented 7 years ago

哦哦，想起来了。当时一个妹子违反了GPL协议，后来就火了。:D

看了一下功能上没啥本质区别，那我就还是ss不R了。

感谢帮忙贴的详细介绍。:)

huan commented 7 years ago

Update:

禁用了压缩和前向纠错功能后，终于跑起来了。我猜是这两个功能里面有指针越界BUG（跨平台相关）

具体参数如下：

--nocomp --parityshard 0  --datashard 0

可惜在DIR-505上只能支持到4Mbps左右的速度（shadowsocks也在路由器上，crypt method salsa20）。准备去买一台极路由3看看效果。

shenfu1991 commented 7 years ago

是流量太大受不了了吧，我之前服务器是 -mtu 1400 -sndwnd 2048 -rcvwnd 2048 ，也是出现你这样的情况，后来改成-mtu 1350-sndwnd 256 -rcvwnd 256就正常了。需要作者@bettermanbao继续优化，感谢

bettermanbao commented 7 years ago

极3也好，K2也好。kcptun+ss的极限速度在10Mbps左右，单上ss的极限速度在40Mbps左右。

首先，一定要开HNAT。这样才能让CPU全部用在kcptun和ss上。

ss用原版，rc4-md5加密。 kcptun，salsa20，fast mode，rcvwnd/sndwnd 256（ping VPS 160ms 的情况下），parityshard/datashard 0。 正常优化就是这样了。

因为主要是kcptun拖后腿，所以更变态一点可以把kcptun的加密设成none，还能再快一些。反正目前没观察到有人关照kcptun协议。

shNanChen commented 7 years ago

@bettermanbao 更极限应该用socks5代理替代ss， 但是路由器上SOCKS5转透明代理不方便。

huan commented 7 years ago

@bettermanbao 你测试一下 --parityshard 10 --datashard 10这样类似的非 0 参数，应该可以复现数组越界崩溃。

bettermanbao commented 7 years ago

@shNanChen 最新版的ssr支持none的加密方式，你可以试试看。

@zixia 试过ramips没有问题，ar71xx没试过。