Closed openaspace closed 3 years ago
Please use template when submitting an issue.
And for redundant mode, it's in Network->MPTCP.
Really thank you. But also in redundant mode and creating 2 subflow instead of 1 .. when a carrier go down , there is a little fraction of second where the global connection go down, please look the screenshot.
https://www.dropbox.com/s/pv9hvys3c17tsrn/Schermata%202020-10-01%20alle%2021.52.21.png?dl=0
and with a live stream on, this mean that the video will go off with unexpected reaction from the RTMP server.
I have tried to set one of the carrier as backup only but till go down when switch. The tunnel vpn is correctly on.
I'm wrong in some settings?
Also with software streaming like OBS and VMIX, when a carrier disconnect and internet connection come back, are not enable to reconnect and I need to close and reopen the streaming software.... it's like the computer client, after the disconnection can't find the route...
You shouldn't create more than 1 subflow. You can increase Multipath TCP SYN retries and change Congestion Control in Network->MPTCP.
I have done a lot of test and configuration.. but also when a carrier go down and I see that the ping command don't produce any lost packet... the streaming connection using OBS or an external hardware encoder, go completely down.
Also, if for example I'm working with a simple file upload, when the wan switch happen , the transfer continue to works correctly without problems. Therefore the real problem is how they manage different kind of connection...
There are some settings that I can test to avoid that a live video broadcast to a RTMP server go down when there is a wan switch?
TCP use shadowsocks, but UDP and ICMP use the VPN. RTMP is over TCP, so not the same path as ICMP.
In State->System log you can check what problem can have ss-redir. Redundant mode for master interface selection should also have no downtime. But you can also check in log if there is no problem with this.
You should also check OBS log if there is any to know why it goes down and maybe increase some timeout.
This my configuration: https://www.dropbox.com/s/5snq9kteii3crz1/OpenMPTCProuter-Interfaces-LuCI.png?dl=0 https://www.dropbox.com/s/ie6a7jvvkum80ru/OpenMPTCProuter-LuCI.png?dl=0 https://www.dropbox.com/s/vd89ly0qogibh2q/OpenMPTCProuter-MPTCP-LuCI.png?dl=0
I have also tried to disable Glorytun and use MLVPN, but the system says me that there two default vpn ..but no other vpn are set as autostart or enabled..
VPN must be modified only via the wizard using advanced settings checkbox.
Looking other similar system I see that exist the "Multipath broadcast" where for example with 3 wan sending simultaneously the same data in the vpn... exist this settings.. because I have in any case a small downtime..
If exit a downtime i can use any lte router with failover..
VPN must be modified only via the wizard using advanced settings checkbox.
Ok. I have modified but whitout significant results...
It's what do redundant mode I think. I never used any similar system. Did you check log ?
Fri Oct 2 14:27:19 2020 daemon.notice netifd: Network device 'eth1' link is down Fri Oct 2 14:27:19 2020 daemon.notice netifd: Interface 'wan1' has link connectivity loss Fri Oct 2 14:27:19 2020 kern.info kernel: [ 1459.857648] r8152 2-3:1.0 eth1: carrier off Fri Oct 2 14:27:29 2020 daemon.err /usr/bin/ss-local[17142]: getpeername: Socket not connected Fri Oct 2 14:27:29 2020 daemon.notice netifd: Network device 'eth1' link is up Fri Oct 2 14:27:29 2020 daemon.notice netifd: Interface 'wan1' has link connectivity Fri Oct 2 14:27:29 2020 kern.info kernel: [ 1469.797525] r8152 2-3:1.0 eth1: carrier on Fri Oct 2 14:27:30 2020 user.notice post-tracking-post-tracking: wan1 (eth1) switched off because gateway down and ping from 192.168.20.150 error (8.8.8.8,8.8.4.4) Fri Oct 2 14:27:30 2020 user.notice post-tracking-post-tracking: Delete default route via 192.168.20.1 dev eth1 Fri Oct 2 14:27:30 2020 user.notice post-tracking-post-tracking: wan1 down. Replace default route by 192.168.20.1 dev eth2 Fri Oct 2 14:27:39 2020 daemon.notice netifd: Network device 'eth2' link is down Fri Oct 2 14:27:39 2020 daemon.notice netifd: Interface 'wan2' has link connectivity loss Fri Oct 2 14:27:40 2020 user.notice post-tracking-post-tracking: wan1 (eth1) switched up Fri Oct 2 14:27:40 2020 user.notice post-tracking-post-tracking: Set server vps (Remote Server ip xxx.xxx.xxx.xxx) default route via 192.168.20.1 Fri Oct 2 14:27:41 2020 daemon.err /usr/bin/ss-redir[17144]: remote recv: Operation timed out Fri Oct 2 14:27:41 2020 daemon.err glorytun[7886]: read: Operation timed out Fri Oct 2 14:27:41 2020 daemon.info glorytun[7886]: STOPPED tun0 Fri Oct 2 14:27:41 2020 daemon.err glorytun[7886]: Remote Server ip xxx.xxx.xxx.xxx.65001: connected Fri Oct 2 14:27:42 2020 user.notice post-tracking-post-tracking: Set server vps (Remote Server ip xxx.xxx.xxx.xxx) route via 192.168.20.1 metric 3 Fri Oct 2 14:27:45 2020 daemon.err /usr/bin/ss-redir[17144]: remote recv: Operation timed out Fri Oct 2 14:27:47 2020 daemon.err omr-tracker[6736]: Failed to send request: Operation not permitted Fri Oct 2 14:27:48 2020 daemon.err /usr/bin/ss-redir[17144]: remote recv: Operation timed out Fri Oct 2 14:27:51 2020 daemon.err glorytun[7886]: Remote Server ip xxx.xxx.xxx.xxx.65001: key exchange failed Fri Oct 2 14:27:51 2020 daemon.info glorytun[7886]: STOPPED tun0 Fri Oct 2 14:27:52 2020 daemon.err glorytun[7886]: Remote Server ip xxx.xxx.xxx.xxx.65001: connected Fri Oct 2 14:27:53 2020 daemon.err /usr/bin/ss-redir[17143]: remote recv: Operation timed out Fri Oct 2 14:27:53 2020 user.notice post-tracking-post-tracking: wan2 (eth2) switched off because gateway down and ping from 192.168.20.151 error (8.8.4.4,9.9.9.9) Fri Oct 2 14:27:53 2020 user.notice post-tracking-post-tracking: Delete default route via 192.168.20.1 dev eth2 Fri Oct 2 14:27:56 2020 user.notice post-tracking-post-tracking: omrvpn down. Replace default route by 192.168.20.1 dev eth1 Fri Oct 2 14:27:56 2020 user.notice post-tracking-post-tracking: omrvpn down because gateway down Fri Oct 2 14:27:56 2020 user.notice post-tracking-post-tracking: Tunnel down use ShadowSocks for UDP Fri Oct 2 14:27:56 2020 user.notice Shadowsocks: Rules DOWN Fri Oct 2 14:27:57 2020 user.notice Shadowsocks: Rules UP Fri Oct 2 14:27:57 2020 daemon.info glorytun[7886]: STARTED tun0 Fri Oct 2 14:27:57 2020 user.notice Shadowsocks: Reload omr-bypass rules Fri Oct 2 14:27:57 2020 user.notice omr-bypass: Starting OMR-ByPass... Fri Oct 2 14:27:57 2020 user.notice omr-bypass: Reload dnsmasq... Fri Oct 2 14:27:57 2020 daemon.info dnsmasq[31976]: read /etc/hosts - 4 addresses Fri Oct 2 14:27:57 2020 daemon.info dnsmasq[31976]: read /tmp/hosts/dhcp.cfg01411c - 2 addresses Fri Oct 2 14:27:57 2020 daemon.info dnsmasq-dhcp[31976]: read /etc/ethers - 0 addresses Fri Oct 2 14:27:57 2020 user.notice omr-bypass: OMR-ByPass is running Fri Oct 2 14:28:03 2020 user.notice post-tracking-post-tracking: Tunnel up : Replace default route by 10.255.255.1 dev tun0 Fri Oct 2 14:28:05 2020 user.notice post-tracking-post-tracking: Tunnel up disable use of ShadowSocks for UDP Fri Oct 2 14:28:05 2020 user.notice Shadowsocks: Rules DOWN Fri Oct 2 14:28:05 2020 user.notice Shadowsocks: Rules UP Fri Oct 2 14:28:05 2020 user.notice Shadowsocks: Reload omr-bypass rules Fri Oct 2 14:28:05 2020 user.notice omr-bypass: Starting OMR-ByPass... Fri Oct 2 14:28:06 2020 user.notice omr-bypass: Reload dnsmasq... Fri Oct 2 14:28:06 2020 daemon.info dnsmasq[31976]: read /etc/hosts - 4 addresses Fri Oct 2 14:28:06 2020 daemon.info dnsmasq[31976]: read /tmp/hosts/dhcp.cfg01411c - 2 addresses Fri Oct 2 14:28:06 2020 daemon.info dnsmasq-dhcp[31976]: read /etc/ethers - 0 addresses Fri Oct 2 14:28:06 2020 user.notice omr-bypass: OMR-ByPass is running Fri Oct 2 14:28:09 2020 daemon.notice netifd: Network device 'eth2' link is up Fri Oct 2 14:28:09 2020 daemon.notice netifd: Interface 'wan2' has link connectivity Fri Oct 2 14:28:09 2020 kern.info kernel: [ 1509.623854] asix 1-6:1.0 eth2: link up, 100Mbps, full-duplex, lpa 0xCDE1 Fri Oct 2 14:28:16 2020 user.notice post-tracking-post-tracking: wan2 (eth2) switched up Fri Oct 2 14:28:16 2020 user.notice post-tracking-post-tracking: Set server vps (Remote Server ip xxx.xxx.xxx.xxx) route via 192.168.20.1 metric 4 Fri Oct 2 14:28:17 2020 daemon.notice netifd: Network device 'eth1' link is down Fri Oct 2 14:28:17 2020 daemon.notice netifd: Interface 'wan1' has link connectivity loss Fri Oct 2 14:28:17 2020 kern.info kernel: [ 1517.800900] r8152 2-3:1.0 eth1: carrier off Fri Oct 2 14:28:18 2020 daemon.err /usr/bin/ss-redir[17143]: remote recv: Operation timed out Fri Oct 2 14:28:18 2020 daemon.err /usr/bin/ss-redir[17143]: remote recv: Operation timed out Fri Oct 2 14:28:19 2020 daemon.err glorytun[7886]: read: Operation timed out Fri Oct 2 14:28:19 2020 daemon.info glorytun[7886]: STOPPED tun0 Fri Oct 2 14:28:20 2020 daemon.err /usr/bin/ss-redir[17144]: remote recv: Host is unreachable Fri Oct 2 14:28:20 2020 daemon.err /usr/bin/ss-local[17142]: getpeername: Socket not connected Fri Oct 2 14:28:20 2020 daemon.err /usr/bin/ss-redir[17143]: remote recv: Host is unreachable Fri Oct 2 14:28:20 2020 daemon.err /usr/bin/ss-redir[17143]: remote recv: Host is unreachable Fri Oct 2 14:28:22 2020 daemon.err /usr/bin/ss-redir[17144]: remote recv: Operation timed out Fri Oct 2 14:28:22 2020 daemon.err /usr/bin/ss-redir[17144]: remote recv: Operation timed out Fri Oct 2 14:28:23 2020 daemon.err /usr/bin/ss-redir[17143]: remote recv: Host is unreachable Fri Oct 2 14:28:23 2020 daemon.err /usr/bin/ss-redir[17144]: remote recv: Host is unreachable Fri Oct 2 14:28:23 2020 daemon.err /usr/bin/ss-redir[17144]: remote recv: Host is unreachable
It's what do redundant mode I think. Here you can find the "broadcast" mode https://zerotier.atlassian.net/wiki/spaces/SD/pages/568459265/Multipath
Selecting " Force retrieve all keys from server." the system appear more reactive.. But a disconnection till happen.. and I see that can't connect to remote server.. can't retrieve scripts....
How the "broadcast" diagram show, I need to obtain exactly the maximum stability with top redundancy over 3 Lte usb keys.
rounrobin it's not correct to manage with the maximum security the link
It's a bonding mode, not related to MPTCP and not really efficient with links that don't have same latency. Force retrieve all keys from server, retrieve all keys/settings from the server when there is an issue, so it's not related at all. I don't understand what you mean by "can't connect to remote server.. can't retrieve scripts...", all is green in status page ?
In log I can see problem with 2 interfaces, but what I need is log when you have an issue only.
Where are the deep logs in the system? The problem with the two interfaces is the simulation of manual link down detaching the ethernet.
.. When link 1 go down, in the main interfaces .. the system report both interfaces down.. but only one is without cable. .. and when unlink ethernet 2 the openmtcrouter section report that can't connect server admin script. (i'm making tests with 1gbps fiber connection with 5ms latency)
Please look the two screenshot. https://www.dropbox.com/s/xkzh47o673xdeq8/OpenMPTCProuter-Stato-LuCI%20%281%29.png?dl=0 https://www.dropbox.com/s/jofw77oz2is12vm/OpenMPTCProuter-Stato-LuCI.png?dl=0
Ok, not related to MPTCP .. but how to set a different bonding logic in the preferences??
thank you for the support.
Ping (ICMP) != RTMP Stream (TCP) Your OBS behavior is also not MPTCP related. Just aggregate the links and your problems are gone?
Deep log ? All logs are in State->System log and State->Kernel log.
Detaching the ethernet is not the same as link down. Redundant mode can't work when an interface is set as backup (this seems normal...).
Screenshot without any info doesn't help. What did you do to get them ?
Please can you give me what I asked you: the log when there is the issue.
Ping (ICMP) != RTMP Stream (TCP) Your OBS behavior is also not MPTCP related. Thank you. Yes I know. But the solution what can be?
Detaching the ethernet is not the same as link down. I'm detaching the cable non the device.
Redundant mode can't work when an interface is set as backup (this seems normal...). Yes, I have checked previously whtout backup mode.
in the kernel log there is no specific log when detaching the ethernet cable from the device produce the ping time out.
Detaching cable give an info to the router.
I need a test done without backup mode and the result in system log.
Without backup: [ 2779.845792] asix 1-6:1.0 eth2: link up, 100Mbps, full-duplex, lpa 0xCDE1 [ 2787.047082] r8152 2-3:1.0 eth1: carrier off [ 2799.195392] r8152 2-3:1.0 eth1: carrier on [ 3033.353440] r8152 2-3:1.0 eth1: carrier off [ 3039.418097] r8152 2-3:1.0 eth1: carrier on [ 3045.025038] asix 1-6:1.0 eth2: link up, 100Mbps, full-duplex, lpa 0xCDE1 [ 3089.050936] asix 1-6:1.0 eth2: link up, 100Mbps, full-duplex, lpa 0xCDE1 [ 3096.412954] r8152 2-3:1.0 eth1: carrier off [ 3102.321378] r8152 2-3:1.0 eth1: carrier on [ 3161.811888] r8152 2-3:1.0 eth1: carrier off [ 3165.576616] r8152 2-3:1.0 eth1: carrier on [ 3171.858099] asix 1-6:1.0 eth2: link up, 100Mbps, full-duplex, lpa 0xCDE1
When the cable disconnect , ping timeout. In the backup mode, sometimes the no time out , the ms increase to 900ms for two ping but no disconnections.
if in the backup mode: icmp_seq=281 ttl=54 time=29.305 ms icmp_seq=282 ttl=54 time=29.546 ms
icmp_seq=288 ttl=54 time=28.901 ms icmp_seq=289 ttl=54 time=29.200 ms
3250.855547] r8152 2-3:1.0 eth1: carrier off [ 3254.364429] r8152 2-3:1.0 eth1: carrier on [ 3268.610049] asix 1-6:1.0 eth2: link up, 100Mbps, full-duplex, lpa 0xCDE1 [ 3329.657587] asix 1-6:1.0 eth2: link up, 100Mbps, full-duplex, lpa 0xCDE1 [ 3337.594774] r8152 2-3:1.0 eth1: carrier off [ 3345.455679] r8152 2-3:1.0 eth1: carrier on [ 3352.570198] r8152 2-3:1.0 eth1: carrier off [ 3358.701851] r8152 2-3:1.0 eth1: carrier on [ 3369.844017] asix 1-6:1.0 eth2: link up, 100Mbps, full-duplex, lpa 0xCDE1
Could be more easy if you connect directly to my desk? :) 🥇
I need system log, not kernel log.
From system log of the web control panel Fri Oct 2 19:00:29 2020 daemon.notice netifd: Network device 'eth2' link is down Fri Oct 2 19:00:29 2020 daemon.notice netifd: Interface 'wan2' has link connectivity loss Fri Oct 2 19:00:31 2020 user.notice post-tracking-post-tracking: Set server vps (xxx.xxx.xxx.xxx) default route xxx.xxx.xxx.xxx nexthop via 192.168.20.1 dev eth1 weight 1 nexthop via 192.168.20.1 dev eth2 weight 10 Fri Oct 2 19:00:33 2020 daemon.err /usr/bin/ss-local[17470]: getpeername: Socket not connected Fri Oct 2 19:00:35 2020 user.notice post-tracking-post-tracking: Set server vps (xxx.xxx.xxx.xxx) default route xxx.xxx.xxx.xxx nexthop via 192.168.20.1 dev eth1 weight 1 nexthop via 192.168.20.1 dev eth2 weight 10 Fri Oct 2 19:00:35 2020 daemon.notice netifd: Network device 'eth2' link is up Fri Oct 2 19:00:35 2020 daemon.notice netifd: Interface 'wan2' has link connectivity Fri Oct 2 19:00:35 2020 kern.info kernel: [ 1069.490931] asix 1-6:1.0 eth2: link up, 100Mbps, full-duplex, lpa 0xCDE1 Fri Oct 2 19:00:36 2020 daemon.err /usr/bin/ss-redir[17471]: remote recv: Host is unreachable Fri Oct 2 19:00:36 2020 daemon.err /usr/bin/ss-redir[17471]: remote recv: Operation timed out Fri Oct 2 19:00:37 2020 daemon.err /usr/bin/ss-redir[17471]: remote recv: Operation timed out
Both WAN are on same network with same gateway, this can't work well.
So.. I think to have found the problem!
I have set congestion control to CUBIC and REDUNDAT.
I start the stream on OBS and on the two phones I see 1000kbps upload on each one!! 👍
... At this point all is working and I disconnect one phone connection, no downtime, obs is correctly streaming without problems! yeah!.... but .. I reconnect the disconnected phone.. and the tcp data continue to go only on the always on phone connection, without restart the REDUNDANT on the reconnected phone!
To have newly the redundancy , I need to stop the STREAM and start it NEWLY! ...... so how to correct this problem?
### UPDATE ** trying to disable and enable more times one connection ... the redundancy start randomly..**
As always I need system log when it's not working.
Hello, thank you! Here the complete Multipath Debug, where 2 tethering lte device are connected, an obs stream stream in redundancy, both devices are working correctly, one device is disconnected and reactivated.. without restart the redundant connecttion.
Sun Oct 4 06:59:32 2020 kern.err kernel: [ 701.716755] mptcp_alloc_mpcb: created mpcb with token 0xa7a7919
Sun Oct 4 06:59:32 2020 kern.err kernel: [ 701.716818] mptcp_add_sock: token 0xa7a7919 pi 1, src_addr:192.168.42.117:62053 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101
Sun Oct 4 06:59:32 2020 kern.err kernel: [ 701.797492] mptcp_add_sock: token 0xa7a7919 pi 2, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0
Sun Oct 4 06:59:32 2020 kern.err kernel: [ 701.797589] mptcp_init4_subsockets: token 0xa7a7919 pi 2 src_addr:192.168.42.29:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 29
Sun Oct 4 06:59:43 2020 kern.err kernel: [ 712.964001] mptcp_close: Close of meta_sk with tok 0x55cf11ed
Sun Oct 4 06:59:43 2020 kern.err kernel: [ 712.985605] mptcp_del_sock: Removing subsock tok 0x55cf11ed pi:1 state 7 is_meta? 0
Sun Oct 4 06:59:43 2020 kern.err kernel: [ 713.028685] mptcp_del_sock: Removing subsock tok 0x55cf11ed pi:2 state 7 is_meta? 0
Sun Oct 4 06:59:43 2020 kern.err kernel: [ 713.028759] mptcp_sock_destruct destroying meta-sk token 0x55cf11ed
Sun Oct 4 06:59:46 2020 kern.err kernel: [ 715.430367] mptcp_alloc_mpcb: created mpcb with token 0xa7475052
Sun Oct 4 06:59:46 2020 kern.err kernel: [ 715.430428] mptcp_add_sock: token 0xa7475052 pi 1, src_addr:192.168.42.117:62065 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101
Sun Oct 4 06:59:46 2020 kern.err kernel: [ 715.517400] mptcp_add_sock: token 0xa7475052 pi 2, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0
Sun Oct 4 06:59:46 2020 kern.err kernel: [ 715.517493] mptcp_init4_subsockets: token 0xa7475052 pi 2 src_addr:192.168.42.29:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 29
Sun Oct 4 06:59:46 2020 kern.err kernel: [ 715.521144] mptcp_alloc_mpcb: created mpcb with token 0xaaac7d9
Sun Oct 4 06:59:46 2020 kern.err kernel: [ 715.521219] mptcp_add_sock: token 0xaaac7d9 pi 1, src_addr:192.168.42.117:62071 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101
Sun Oct 4 06:59:46 2020 kern.err kernel: [ 715.610101] mptcp_add_sock: token 0xaaac7d9 pi 2, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0
Sun Oct 4 06:59:46 2020 kern.err kernel: [ 715.610178] __mptcp_init4_subsockets: token 0xaaac7d9 pi 2 src_addr:192.168.42.29:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 29
Sun Oct 4 06:59:49 2020 kern.err kernel: [ 719.245446] mptcp_close: Close of meta_sk with tok 0x2789d009
Sun Oct 4 06:59:49 2020 kern.err kernel: [ 719.365309] mptcp_del_sock: Removing subsock tok 0x2789d009 pi:2 state 7 is_meta? 0
Sun Oct 4 06:59:49 2020 kern.err kernel: [ 719.365494] mptcp_sock_destruct destroying meta-sk token 0x2789d009
Sun Oct 4 06:59:57 2020 kern.err kernel: [ 726.997520] mptcp_del_sock: Removing subsock tok 0x4912f299 pi:1 state 7 is_meta? 0
Sun Oct 4 07:00:02 2020 kern.err kernel: [ 732.252048] mptcp_close: Close of meta_sk with tok 0xaaac7d9
Sun Oct 4 07:00:02 2020 kern.err kernel: [ 732.274330] mptcp_del_sock: Removing subsock tok 0xaaac7d9 pi:2 state 7 is_meta? 0
Sun Oct 4 07:00:03 2020 kern.err kernel: [ 732.420643] mptcp_del_sock: Removing subsock tok 0xaaac7d9 pi:1 state 7 is_meta? 0
Sun Oct 4 07:00:03 2020 kern.err kernel: [ 732.420726] mptcp_sock_destruct destroying meta-sk token 0xaaac7d9
Sun Oct 4 07:00:05 2020 kern.err kernel: [ 734.637745] mptcp_close: Close of meta_sk with tok 0xa7a7919
Sun Oct 4 07:00:05 2020 kern.info kernel: [ 734.678929] usb 1-1.4: USB disconnect, device number 13
Sun Oct 4 07:00:05 2020 daemon.notice netifd: Network device 'usb0' link is down
Sun Oct 4 07:00:05 2020 daemon.notice netifd: Interface 'wan2' has link connectivity loss
Sun Oct 4 07:00:05 2020 kern.info kernel: [ 734.680659] rndis_host 1-1.4:1.0 usb0: unregister 'rndis_host' usb-0000:00:12.2-1.4, RNDIS device
Sun Oct 4 07:00:05 2020 kern.err kernel: [ 734.683795] addr4_event_handler created event for 192.168.42.117, code 2 prio 0 idx 30
Sun Oct 4 07:00:05 2020 daemon.debug dnsmasq[1758]: stopped listening on usb0(#30): 192.168.42.117 port 53
Sun Oct 4 07:00:05 2020 kern.err kernel: [ 734.685070] addr4_event_handler created event for 192.168.42.117, code 2 prio 0 idx 30
Sun Oct 4 07:00:05 2020 kern.err kernel: [ 734.685142] add_pm_event del old_code 2
Sun Oct 4 07:00:05 2020 user.notice ModemManager: hotplug: remove network interface usb0: event processed
Sun Oct 4 07:00:05 2020 user.notice ModemManager: hotplug: event reported: action=remove, name=usb0, subsystem=net
Sun Oct 4 07:00:05 2020 kern.err kernel: [ 734.725606] mptcp_del_sock: Removing subsock tok 0xa7a7919 pi:2 state 7 is_meta? 0
Sun Oct 4 07:00:05 2020 daemon.notice netifd: wan2 (30605): udhcpc: SIOCGIFINDEX: No such device
Sun Oct 4 07:00:05 2020 daemon.notice netifd: wan2 (30605): udhcpc: received SIGTERM
Sun Oct 4 07:00:05 2020 daemon.notice netifd: wan2 (30605): udhcpc: unicasting a release of 192.168.42.117 to 192.168.42.129
Sun Oct 4 07:00:05 2020 daemon.notice netifd: wan2 (30605): udhcpc: sending release
Sun Oct 4 07:00:05 2020 daemon.notice netifd: wan2 (30605): udhcpc: bind(UDP): Address not available
Sun Oct 4 07:00:05 2020 daemon.notice netifd: wan2 (30605): udhcpc: entering released state
Sun Oct 4 07:00:05 2020 daemon.notice netifd: wan2 (30605): Command failed: Permission denied
Sun Oct 4 07:00:05 2020 daemon.notice netifd: Interface 'wan2' is now down
Sun Oct 4 07:00:05 2020 daemon.notice netifd: Interface 'wan2' is disabled
Sun Oct 4 07:00:05 2020 kern.info kernel: [ 735.156637] usb 1-1.4: new high-speed USB device number 14 using ehci-pci
Sun Oct 4 07:00:05 2020 kern.err kernel: [ 735.213057] mptcp_del_sock: Removing subsock tok 0xa7475052 pi:1 state 7 is_meta? 0
Sun Oct 4 07:00:05 2020 kern.info kernel: [ 735.266867] usb-storage 1-1.4:1.1: USB Mass Storage device detected
Sun Oct 4 07:00:05 2020 kern.info kernel: [ 735.268896] scsi host2: usb-storage 1-1.4:1.1
Sun Oct 4 07:00:06 2020 kern.notice kernel: [ 736.301474] scsi 2:0:0:0: CD-ROM Linux File-CD Gadget 0409 PQ: 0 ANSI: 2
Sun Oct 4 07:00:06 2020 kern.warn kernel: [ 736.303211] sr 2:0:0:0: Power-on or device reset occurred
Sun Oct 4 07:00:06 2020 kern.info kernel: [ 736.304631] sr 2:0:0:0: [sr1] scsi-1 drive
Sun Oct 4 07:00:06 2020 kern.debug kernel: [ 736.304909] sr 2:0:0:0: Attached scsi CD-ROM sr1
Sun Oct 4 07:00:07 2020 user.notice post-tracking-post-tracking: Set server vps (vps_server: xxx.xxx.xxx.xxx) default route vps_server: xxx.xxx.xxx.xxx nexthop via 192.168.42.129 dev usb1 weight 1
Sun Oct 4 07:00:07 2020 user.notice omr-bypass: Starting OMR-ByPass...
Sun Oct 4 07:00:08 2020 user.notice omr-bypass: Restart dnsmasq...
Sun Oct 4 07:00:08 2020 daemon.info dnsmasq[1758]: exiting on receipt of SIGTERM
Sun Oct 4 07:00:08 2020 user.notice dnsmasq: DNS rebinding protection is active, will discard upstream RFC1918 responses!
Sun Oct 4 07:00:08 2020 user.notice dnsmasq: Allowing 127.0.0.0/8 responses
Sun Oct 4 07:00:08 2020 user.notice dnsmasq: Allowing RFC1918 responses for domain plex.direct
Sun Oct 4 07:00:08 2020 user.notice omr-bypass: OMR-ByPass is running
Sun Oct 4 07:00:08 2020 daemon.info dnsmasq[19413]: started, version 2.82 cachesize 150
Sun Oct 4 07:00:08 2020 daemon.info dnsmasq[19413]: DNS service limited to local subnets
Sun Oct 4 07:00:08 2020 daemon.info dnsmasq[19413]: compile time options: IPv6 GNU-getopt no-DBus UBus no-i18n no-IDN DHCP DHCPv6 no-Lua TFTP conntrack ipset auth DNSSEC no-ID loop-detect inotify dumpfile
Sun Oct 4 07:00:08 2020 daemon.info dnsmasq-dhcp[19413]: DHCP, IP range 192.168.100.100 -- 192.168.100.249, lease time 12h
Sun Oct 4 07:00:08 2020 daemon.info dnsmasq[19413]: using only locally-known addresses for domain test
Sun Oct 4 07:00:08 2020 daemon.info dnsmasq[19413]: using only locally-known addresses for domain onion
Sun Oct 4 07:00:08 2020 daemon.info dnsmasq[19413]: using only locally-known addresses for domain localhost
Sun Oct 4 07:00:08 2020 daemon.info dnsmasq[19413]: using only locally-known addresses for domain local
Sun Oct 4 07:00:08 2020 daemon.info dnsmasq[19413]: using only locally-known addresses for domain invalid
Sun Oct 4 07:00:08 2020 daemon.info dnsmasq[19413]: using only locally-known addresses for domain bind
Sun Oct 4 07:00:08 2020 daemon.info dnsmasq[19413]: using only locally-known addresses for domain use-application-dns.net
Sun Oct 4 07:00:08 2020 daemon.info dnsmasq[19413]: using only locally-known addresses for domain lan
Sun Oct 4 07:00:08 2020 daemon.info dnsmasq[19413]: using nameserver 127.0.0.1#5353
Sun Oct 4 07:00:08 2020 daemon.info dnsmasq[19413]: using 1 more local addresses
Sun Oct 4 07:00:08 2020 daemon.info dnsmasq[19413]: read /etc/hosts - 4 addresses
Sun Oct 4 07:00:08 2020 daemon.info dnsmasq[19413]: read /tmp/hosts/dhcp.cfg01411c - 2 addresses
Sun Oct 4 07:00:08 2020 daemon.info dnsmasq-dhcp[19413]: read /etc/ethers - 0 addresses
Sun Oct 4 07:00:09 2020 user.notice post-tracking-post-tracking: omrvpn down. Replace default route by 192.168.42.129 dev usb1
Sun Oct 4 07:00:09 2020 user.notice post-tracking-post-tracking: omrvpn down because gateway down
Sun Oct 4 07:00:09 2020 user.notice post-tracking-post-tracking: Tunnel down use ShadowSocks for UDP
Sun Oct 4 07:00:09 2020 user.notice Shadowsocks: Rules DOWN
Sun Oct 4 07:00:09 2020 daemon.err glorytun[7682]: write: Operation timed out
Sun Oct 4 07:00:09 2020 daemon.info glorytun[7682]: STOPPED tun0
Sun Oct 4 07:00:09 2020 kern.err kernel: [ 739.052633] mptcp_close: Close of meta_sk with tok 0x4912f299
Sun Oct 4 07:00:09 2020 kern.err kernel: [ 739.052696] mptcp_sock_destruct destroying meta-sk token 0x4912f299
Sun Oct 4 07:00:09 2020 daemon.err omr-tracker[12617]: Another app is currently holding the xtables lock. Perhaps you want to use the -w option?
Sun Oct 4 07:00:09 2020 user.notice Shadowsocks: Rules UP
Sun Oct 4 07:00:09 2020 kern.err kernel: [ 739.223244] mptcp_alloc_mpcb: created mpcb with token 0xa96a2273
Sun Oct 4 07:00:09 2020 kern.err kernel: [ 739.223305] mptcp_add_sock: token 0xa96a2273 pi 1, src_addr:192.168.42.29:15905 dst_addr:vps_server: xxx.xxx.xxx.xxx:65500
Sun Oct 4 07:00:09 2020 user.notice Shadowsocks: Reload omr-bypass rules
Sun Oct 4 07:00:09 2020 user.notice omr-bypass: Starting OMR-ByPass...
Sun Oct 4 07:00:09 2020 kern.err kernel: [ 739.312314] mptcp_close: Close of meta_sk with tok 0xa96a2273
Sun Oct 4 07:00:09 2020 kern.err kernel: [ 739.347953] mptcp_del_sock: Removing subsock tok 0xa96a2273 pi:1 state 7 is_meta? 0
Sun Oct 4 07:00:09 2020 kern.err kernel: [ 739.348029] mptcp_sock_destruct destroying meta-sk token 0xa96a2273
Sun Oct 4 07:00:09 2020 kern.err kernel: [ 739.357076] mptcp_alloc_mpcb: created mpcb with token 0x2325d399
Sun Oct 4 07:00:09 2020 kern.err kernel: [ 739.357136] mptcp_add_sock: token 0x2325d399 pi 1, src_addr:192.168.42.29:15907 dst_addr:vps_server: xxx.xxx.xxx.xxx:65500
Sun Oct 4 07:00:10 2020 kern.err kernel: [ 739.455446] mptcp_close: Close of meta_sk with tok 0x2325d399
Sun Oct 4 07:00:10 2020 kern.err kernel: [ 739.483190] mptcp_del_sock: Removing subsock tok 0x2325d399 pi:1 state 7 is_meta? 0
Sun Oct 4 07:00:10 2020 kern.err kernel: [ 739.483294] mptcp_sock_destruct destroying meta-sk token 0x2325d399
Sun Oct 4 07:00:10 2020 kern.err kernel: [ 739.486081] mptcp_alloc_mpcb: created mpcb with token 0xf1e610cd
Sun Oct 4 07:00:10 2020 kern.err kernel: [ 739.486144] mptcp_add_sock: token 0xf1e610cd pi 1, src_addr:192.168.42.29:15909 dst_addr:vps_server: xxx.xxx.xxx.xxx:65500
Sun Oct 4 07:00:10 2020 daemon.err glorytun[7682]: vps_server: xxx.xxx.xxx.xxx.65001: connected
Sun Oct 4 07:00:10 2020 kern.err kernel: [ 739.586449] mptcp_alloc_mpcb: created mpcb with token 0x461ac80e
Sun Oct 4 07:00:10 2020 kern.err kernel: [ 739.586511] mptcp_add_sock: token 0x461ac80e pi 1, src_addr:192.168.42.29:48239 dst_addr:vps_server: xxx.xxx.xxx.xxx:65001
Sun Oct 4 07:00:10 2020 kern.err kernel: [ 739.587401] mptcp_close: Close of meta_sk with tok 0xf1e610cd
Sun Oct 4 07:00:10 2020 daemon.info glorytun[7682]: STARTED tun0
Sun Oct 4 07:00:10 2020 kern.err kernel: [ 739.619953] mptcp_del_sock: Removing subsock tok 0xf1e610cd pi:1 state 7 is_meta? 0
Sun Oct 4 07:00:10 2020 kern.err kernel: [ 739.620028] mptcp_sock_destruct destroying meta-sk token 0xf1e610cd
Sun Oct 4 07:00:10 2020 user.notice omr-bypass: Reload dnsmasq...
Sun Oct 4 07:00:10 2020 daemon.info dnsmasq[19413]: read /etc/hosts - 4 addresses
Sun Oct 4 07:00:10 2020 daemon.info dnsmasq[19413]: read /tmp/hosts/dhcp.cfg01411c - 2 addresses
Sun Oct 4 07:00:10 2020 daemon.info dnsmasq-dhcp[19413]: read /etc/ethers - 0 addresses
Sun Oct 4 07:00:10 2020 user.notice omr-bypass: OMR-ByPass is running
Sun Oct 4 07:00:11 2020 kern.err kernel: [ 740.480523] mptcp_alloc_mpcb: created mpcb with token 0x19630e5f
Sun Oct 4 07:00:11 2020 kern.err kernel: [ 740.480584] mptcp_add_sock: token 0x19630e5f pi 1, src_addr:192.168.42.29:15537 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101
Sun Oct 4 07:00:11 2020 kern.err kernel: [ 740.506650] mptcp_alloc_mpcb: created mpcb with token 0x9247caca
Sun Oct 4 07:00:11 2020 kern.err kernel: [ 740.506709] mptcp_add_sock: token 0x9247caca pi 1, src_addr:192.168.42.29:15541 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101
Sun Oct 4 07:00:12 2020 kern.info kernel: [ 741.846126] usb 1-1.4: USB disconnect, device number 14
Sun Oct 4 07:00:12 2020 kern.info kernel: [ 742.196436] usb 1-1.4: new high-speed USB device number 15 using ehci-pci
Sun Oct 4 07:00:12 2020 daemon.notice netifd: Interface 'wan2' is enabled
Sun Oct 4 07:00:12 2020 daemon.notice netifd: Interface 'wan2' is setting up now
Sun Oct 4 07:00:12 2020 daemon.notice netifd: Network device 'usb0' link is up
Sun Oct 4 07:00:12 2020 daemon.notice netifd: Interface 'wan2' has link connectivity
Sun Oct 4 07:00:12 2020 kern.info kernel: [ 742.307748] rndis_host 1-1.4:1.0 usb0: register 'rndis_host' at usb-0000:00:12.2-1.4, RNDIS device, 8a:22:7b:d0:fd:ae
Sun Oct 4 07:00:12 2020 daemon.notice netifd: wan2 (21403): udhcpc: started, v1.31.1
Sun Oct 4 07:00:12 2020 daemon.notice netifd: wan2 (21403): udhcpc: sending discover
Sun Oct 4 07:00:13 2020 user.notice ModemManager: hotplug: add network interface usb0: event processed
Sun Oct 4 07:00:13 2020 user.notice ModemManager: hotplug: event reported: action=add, name=usb0, subsystem=net
Sun Oct 4 07:00:13 2020 user.notice ModemManager: hotplug: no need to wait for modem at sysfs path /sys/devices/pci0000:00/0000:00:12.2/usb1/1-1/1-1.4
Sun Oct 4 07:00:15 2020 daemon.info [5775]:
UPDATE Configuration: 2 LTE tethering phones Problem: when one phones disconnect and reconnect, no redundancy is newly established. NEWS: When the reconnected phone don't restart the redundancy data trasnfer after the reconnection, if I connect an ethernet device, on the reconnected phone restart the redundancy transfer
Sun Oct 4 07:15:34 2020 user.notice post-tracking-post-tracking: wan1 (eth1) switched up Sun Oct 4 07:15:34 2020 user.notice post-tracking-post-tracking: Set server vps (vps_server: xxx.xxx.xxx.xxx) default route vps_server: xxx.xxx.xxx.xxx nexthop via 192.168.42.129 dev usb0 weight 1 nexthop via 192.168.42.129 dev usb1 weight 1 nexthop via 192.168.20.1 dev eth1 weight 1 Sun Oct 4 07:15:34 2020 daemon.err omr-tracker[12615]: sendto: Operation not permitted Sun Oct 4 07:15:34 2020 daemon.err omr-tracker[12615]: sendto: Operation not permitted Sun Oct 4 07:15:34 2020 kern.err kernel: [ 1663.821761] mptcp_alloc_mpcb: created mpcb with token 0x5e3d85a6 Sun Oct 4 07:15:34 2020 kern.err kernel: [ 1663.821822] mptcp_add_sock: token 0x5e3d85a6 pi 1, src_addr:192.168.42.117:62437 dst_addr:vps_server: xxx.xxx.xxx.xxx:65500 Sun Oct 4 07:15:34 2020 kern.err kernel: [ 1663.902489] mptcp_add_sock: token 0x5e3d85a6 pi 2, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:15:34 2020 kern.err kernel: [ 1663.902609] mptcp_init4_subsockets: token 0x5e3d85a6 pi 2 src_addr:192.168.42.29:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65500 ifidx: 41 Sun Oct 4 07:15:34 2020 kern.err kernel: [ 1663.902721] mptcp_add_sock: token 0x5e3d85a6 pi 3, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:15:34 2020 kern.err kernel: [ 1663.902789] __mptcp_init4_subsockets: token 0x5e3d85a6 pi 3 src_addr:192.168.20.243:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65500 ifidx: 11 Sun Oct 4 07:15:34 2020 kern.err kernel: [ 1663.973246] mptcp_close: Close of meta_sk with tok 0x5e3d85a6 Sun Oct 4 07:15:34 2020 kern.err kernel: [ 1663.992557] mptcp_del_sock: Removing subsock tok 0x5e3d85a6 pi:3 state 7 is_meta? 0 Sun Oct 4 07:15:34 2020 kern.err kernel: [ 1664.044583] mptcp_del_sock: Removing subsock tok 0x5e3d85a6 pi:1 state 7 is_meta? 0 Sun Oct 4 07:15:34 2020 kern.err kernel: [ 1664.054188] mptcp_del_sock: Removing subsock tok 0x5e3d85a6 pi:2 state 7 is_meta? 0 Sun Oct 4 07:15:34 2020 kern.err kernel: [ 1664.054256] mptcp_sock_destruct destroying meta-sk token 0x5e3d85a6 Sun Oct 4 07:15:34 2020 kern.err kernel: [ 1664.061588] mptcp_alloc_mpcb: created mpcb with token 0x74b20d82 Sun Oct 4 07:15:34 2020 kern.err kernel: [ 1664.061643] mptcp_add_sock: token 0x74b20d82 pi 1, src_addr:192.168.42.117:62439 dst_addr:vps_server: xxx.xxx.xxx.xxx:65500 Sun Oct 4 07:15:34 2020 kern.err kernel: [ 1664.154721] mptcp_add_sock: token 0x74b20d82 pi 2, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:15:34 2020 kern.err kernel: [ 1664.154815] mptcp_init4_subsockets: token 0x74b20d82 pi 2 src_addr:192.168.42.29:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65500 ifidx: 41 Sun Oct 4 07:15:34 2020 kern.err kernel: [ 1664.154945] mptcp_add_sock: token 0x74b20d82 pi 3, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:15:34 2020 kern.err kernel: [ 1664.155016] mptcp_init4_subsockets: token 0x74b20d82 pi 3 src_addr:192.168.20.243:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65500 ifidx: 11 Sun Oct 4 07:15:34 2020 kern.err kernel: [ 1664.235469] mptcp_close: Close of meta_sk with tok 0x74b20d82 Sun Oct 4 07:15:34 2020 kern.err kernel: [ 1664.255267] mptcp_del_sock: Removing subsock tok 0x74b20d82 pi:3 state 7 is_meta? 0 Sun Oct 4 07:15:34 2020 kern.err kernel: [ 1664.314671] mptcp_del_sock: Removing subsock tok 0x74b20d82 pi:1 state 7 is_meta? 0 Sun Oct 4 07:15:34 2020 kern.err kernel: [ 1664.319542] mptcp_alloc_mpcb: created mpcb with token 0x74eebd4a Sun Oct 4 07:15:34 2020 kern.err kernel: [ 1664.319596] mptcp_add_sock: token 0x74eebd4a pi 1, src_addr:192.168.42.117:62441 dst_addr:vps_server: xxx.xxx.xxx.xxx:65500 Sun Oct 4 07:15:34 2020 kern.err kernel: [ 1664.333275] mptcp_del_sock: Removing subsock tok 0x74b20d82 pi:2 state 7 is_meta? 0 Sun Oct 4 07:15:34 2020 kern.err kernel: [ 1664.333351] mptcp_sock_destruct destroying meta-sk token 0x74b20d82 Sun Oct 4 07:15:35 2020 kern.err kernel: [ 1664.407953] mptcp_add_sock: token 0x74eebd4a pi 2, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:15:35 2020 kern.err kernel: [ 1664.408049] __mptcp_init4_subsockets: token 0x74eebd4a pi 2 src_addr:192.168.42.29:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65500 ifidx: 41 Sun Oct 4 07:15:35 2020 kern.err kernel: [ 1664.408246] mptcp_add_sock: token 0x74eebd4a pi 3, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:15:35 2020 kern.err kernel: [ 1664.408320] mptcp_init4_subsockets: token 0x74eebd4a pi 3 src_addr:192.168.20.243:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65500 ifidx: 11 Sun Oct 4 07:15:35 2020 kern.err kernel: [ 1664.490715] mptcp_close: Close of meta_sk with tok 0x74eebd4a Sun Oct 4 07:15:35 2020 kern.err kernel: [ 1664.510240] mptcp_del_sock: Removing subsock tok 0x74eebd4a pi:3 state 7 is_meta? 0 Sun Oct 4 07:15:35 2020 kern.err kernel: [ 1664.510320] mptcp_del_sock: Removing subsock tok 0x74eebd4a pi:2 state 7 is_meta? 0 Sun Oct 4 07:15:35 2020 kern.err kernel: [ 1664.639526] mptcp_del_sock: Removing subsock tok 0x74eebd4a pi:1 state 7 is_meta? 0 Sun Oct 4 07:15:35 2020 kern.err kernel: [ 1664.639603] mptcp_sock_destruct destroying meta-sk token 0x74eebd4a Sun Oct 4 07:15:35 2020 kern.err kernel: [ 1664.721511] mptcp_alloc_mpcb: created mpcb with token 0x94260a35 Sun Oct 4 07:15:35 2020 kern.err kernel: [ 1664.721572] mptcp_add_sock: token 0x94260a35 pi 1, src_addr:192.168.20.243:19759 dst_addr:vps_server: xxx.xxx.xxx.xxx:65500 Sun Oct 4 07:15:35 2020 kern.err kernel: [ 1664.734029] mptcp_del_sock: Removing subsock tok 0xb92c16bd pi:2 state 7 is_meta? 0 Sun Oct 4 07:15:35 2020 kern.err kernel: [ 1664.734118] mptcp_add_sock: token 0xb92c16bd pi 2, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:15:35 2020 kern.err kernel: [ 1664.734192] mptcp_init4_subsockets: token 0xb92c16bd pi 2 src_addr:192.168.42.29:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 41 Sun Oct 4 07:15:35 2020 kern.err kernel: [ 1664.734313] mptcp_add_sock: token 0xb92c16bd pi 3, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:15:35 2020 kern.err kernel: [ 1664.734382] __mptcp_init4_subsockets: token 0xb92c16bd pi 3 src_addr:192.168.20.243:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 11 Sun Oct 4 07:15:35 2020 kern.err kernel: [ 1664.746511] mptcp_add_sock: token 0x94260a35 pi 2, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:15:35 2020 kern.err kernel: [ 1664.746593] mptcp_init4_subsockets: token 0x94260a35 pi 2 src_addr:192.168.42.29:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65500 ifidx: 41 Sun Oct 4 07:15:35 2020 kern.err kernel: [ 1664.746733] mptcp_add_sock: token 0x94260a35 pi 3, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:15:35 2020 kern.err kernel: [ 1664.746805] mptcp_init4_subsockets: token 0x94260a35 pi 3 src_addr:192.168.42.117:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65500 ifidx: 38 Sun Oct 4 07:15:35 2020 kern.err kernel: [ 1664.796753] mptcp_close: Close of meta_sk with tok 0x94260a35 Sun Oct 4 07:15:35 2020 kern.err kernel: [ 1664.816216] mptcp_del_sock: Removing subsock tok 0x94260a35 pi:3 state 7 is_meta? 0 Sun Oct 4 07:15:35 2020 kern.err kernel: [ 1664.816296] mptcp_del_sock: Removing subsock tok 0x94260a35 pi:2 state 7 is_meta? 0 Sun Oct 4 07:15:35 2020 kern.err kernel: [ 1664.816372] mptcp_del_sock: Removing subsock tok 0x94260a35 pi:1 state 7 is_meta? 0 Sun Oct 4 07:15:35 2020 kern.err kernel: [ 1664.816439] mptcp_sock_destruct destroying meta-sk token 0x94260a35 Sun Oct 4 07:15:35 2020 kern.err kernel: [ 1664.933840] mptcp_alloc_mpcb: created mpcb with token 0xfab8f55e Sun Oct 4 07:15:35 2020 kern.err kernel: [ 1664.933902] mptcp_add_sock: token 0xfab8f55e pi 1, src_addr:192.168.42.117:63669 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 Sun Oct 4 07:15:35 2020 kern.err kernel: [ 1664.990012] mptcp_del_sock: Removing subsock tok 0x880600d3 pi:2 state 7 is_meta? 0 Sun Oct 4 07:15:35 2020 kern.err kernel: [ 1664.990102] mptcp_add_sock: token 0x880600d3 pi 2, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:15:35 2020 kern.err kernel: [ 1664.990176] mptcp_init4_subsockets: token 0x880600d3 pi 2 src_addr:192.168.42.29:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 41 Sun Oct 4 07:15:35 2020 kern.err kernel: [ 1664.990296] mptcp_add_sock: token 0x880600d3 pi 3, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:15:35 2020 kern.err kernel: [ 1664.990363] mptcp_init4_subsockets: token 0x880600d3 pi 3 src_addr:192.168.20.243:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 11 Sun Oct 4 07:15:35 2020 kern.err kernel: [ 1665.018074] mptcp_add_sock: token 0xfab8f55e pi 2, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:15:35 2020 kern.err kernel: [ 1665.018153] __mptcp_init4_subsockets: token 0xfab8f55e pi 2 src_addr:192.168.42.29:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 41 Sun Oct 4 07:15:35 2020 kern.err kernel: [ 1665.018299] mptcp_add_sock: token 0xfab8f55e pi 3, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:15:35 2020 kern.err kernel: [ 1665.018367] mptcp_init4_subsockets: token 0xfab8f55e pi 3 src_addr:192.168.20.243:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 11 Sun Oct 4 07:15:36 2020 kern.err kernel: [ 1666.014005] mptcp_del_sock: Removing subsock tok 0xd893e9ff pi:2 state 7 is_meta? 0 Sun Oct 4 07:15:36 2020 kern.err kernel: [ 1666.014094] mptcp_add_sock: token 0xd893e9ff pi 2, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:15:36 2020 kern.err kernel: [ 1666.014168] mptcp_init4_subsockets: token 0xd893e9ff pi 2 src_addr:192.168.42.29:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65001 ifidx: 41 Sun Oct 4 07:15:36 2020 kern.err kernel: [ 1666.014283] mptcp_add_sock: token 0xd893e9ff pi 3, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:15:36 2020 kern.err kernel: [ 1666.014350] mptcp_init4_subsockets: token 0xd893e9ff pi 3 src_addr:192.168.20.243:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65001 ifidx: 11 Sun Oct 4 07:15:36 2020 kern.err kernel: [ 1666.282317] mptcp_close: Close of meta_sk with tok 0x880600d3 Sun Oct 4 07:15:36 2020 kern.err kernel: [ 1666.302199] mptcp_del_sock: Removing subsock tok 0x880600d3 pi:2 state 7 is_meta? 0 Sun Oct 4 07:15:36 2020 kern.err kernel: [ 1666.302292] mptcp_del_sock: Removing subsock tok 0x880600d3 pi:1 state 7 is_meta? 0 Sun Oct 4 07:15:36 2020 kern.err kernel: [ 1666.342149] mptcp_del_sock: Removing subsock tok 0x880600d3 pi:3 state 7 is_meta? 0 Sun Oct 4 07:15:36 2020 kern.err kernel: [ 1666.342225] mptcp_sock_destruct destroying meta-sk token 0x880600d3 Sun Oct 4 07:15:37 2020 kern.err kernel: [ 1667.037985] mptcp_del_sock: Removing subsock tok 0x5d13e483 pi:1 state 7 is_meta? 0 Sun Oct 4 07:15:37 2020 kern.err kernel: [ 1667.038090] mptcp_del_sock: Removing subsock tok 0x5d13e483 pi:2 state 7 is_meta? 0 Sun Oct 4 07:15:37 2020 kern.err kernel: [ 1667.038181] mptcp_add_sock: token 0x5d13e483 pi 1, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:15:37 2020 kern.err kernel: [ 1667.038253] mptcp_init4_subsockets: token 0x5d13e483 pi 1 src_addr:192.168.42.29:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 41 Sun Oct 4 07:15:37 2020 kern.err kernel: [ 1667.038371] mptcp_add_sock: token 0x5d13e483 pi 2, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:15:37 2020 kern.err kernel: [ 1667.038439] mptcp_init4_subsockets: token 0x5d13e483 pi 2 src_addr:192.168.20.243:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 11 Sun Oct 4 07:15:37 2020 kern.err kernel: [ 1667.038541] mptcp_add_sock: token 0x5d13e483 pi 3, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:15:37 2020 kern.err kernel: [ 1667.038608] mptcp_init4_subsockets: token 0x5d13e483 pi 3 src_addr:192.168.42.117:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 38 Sun Oct 4 07:15:40 2020 kern.err kernel: [ 1669.597910] mptcp_del_sock: Removing subsock tok 0x733f8d2f pi:2 state 7 is_meta? 0 Sun Oct 4 07:15:40 2020 kern.err kernel: [ 1669.597997] mptcp_add_sock: token 0x733f8d2f pi 2, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:15:40 2020 kern.err kernel: [ 1669.598068] mptcp_init4_subsockets: token 0x733f8d2f pi 2 src_addr:192.168.42.29:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 41 Sun Oct 4 07:15:40 2020 kern.err kernel: [ 1669.598182] mptcp_add_sock: token 0x733f8d2f pi 3, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:15:40 2020 kern.err kernel: [ 1669.598250] mptcp_init4_subsockets: token 0x733f8d2f pi 3 src_addr:192.168.20.243:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 11 Sun Oct 4 07:15:40 2020 kern.err kernel: [ 1669.853904] mptcp_del_sock: Removing subsock tok 0xb92c16bd pi:2 state 7 is_meta? 0 Sun Oct 4 07:15:40 2020 kern.err kernel: [ 1669.853990] mptcp_add_sock: token 0xb92c16bd pi 2, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:15:40 2020 kern.err kernel: [ 1669.854061] mptcp_init4_subsockets: token 0xb92c16bd pi 2 src_addr:192.168.42.29:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 41 Sun Oct 4 07:15:40 2020 kern.err kernel: [ 1670.353350] mptcp_alloc_mpcb: created mpcb with token 0x65456aeb Sun Oct 4 07:15:40 2020 kern.err kernel: [ 1670.353411] mptcp_add_sock: token 0x65456aeb pi 1, src_addr:192.168.42.117:63685 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 Sun Oct 4 07:15:41 2020 kern.err kernel: [ 1670.443635] mptcp_add_sock: token 0x65456aeb pi 2, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:15:41 2020 kern.err kernel: [ 1670.443722] mptcp_init4_subsockets: token 0x65456aeb pi 2 src_addr:192.168.42.29:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 41 Sun Oct 4 07:15:41 2020 kern.err kernel: [ 1670.443839] mptcp_add_sock: token 0x65456aeb pi 3, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:15:41 2020 kern.err kernel: [ 1670.443916] mptcp_init4_subsockets: token 0x65456aeb pi 3 src_addr:192.168.20.243:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 11 Sun Oct 4 07:15:42 2020 kern.err kernel: [ 1671.645887] mptcp_del_sock: Removing subsock tok 0x28fe9f3b pi:2 state 7 is_meta? 0 Sun Oct 4 07:15:42 2020 kern.err kernel: [ 1671.645974] mptcp_add_sock: token 0x28fe9f3b pi 2, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:15:42 2020 kern.err kernel: [ 1671.646048] mptcp_init4_subsockets: token 0x28fe9f3b pi 2 src_addr:192.168.42.29:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 41 Sun Oct 4 07:15:42 2020 kern.err kernel: [ 1671.646159] mptcp_add_sock: token 0x28fe9f3b pi 3, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:15:42 2020 kern.err kernel: [ 1671.646229] mptcp_init4_subsockets: token 0x28fe9f3b pi 3 src_addr:192.168.20.243:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 11 Sun Oct 4 07:15:52 2020 kern.err kernel: [ 1681.629734] mptcp_del_sock: Removing subsock tok 0xe3948f7f pi:2 state 7 is_meta? 0 Sun Oct 4 07:15:52 2020 kern.err kernel: [ 1681.629820] mptcp_add_sock: token 0xe3948f7f pi 2, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:15:52 2020 kern.err kernel: [ 1681.629893] mptcp_init4_subsockets: token 0xe3948f7f pi 2 src_addr:192.168.42.29:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 41 Sun Oct 4 07:15:52 2020 kern.err kernel: [ 1681.630028] mptcp_add_sock: token 0xe3948f7f pi 3, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:15:52 2020 kern.err kernel: [ 1681.630098] __mptcp_init4_subsockets: token 0xe3948f7f pi 3 src_addr:192.168.20.243:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 11 Sun Oct 4 07:15:52 2020 kern.err kernel: [ 1681.842318] mptcp_close: Close of meta_sk with tok 0xfab8f55e Sun Oct 4 07:15:52 2020 kern.err kernel: [ 1681.861414] mptcp_del_sock: Removing subsock tok 0xfab8f55e pi:2 state 7 is_meta? 0 Sun Oct 4 07:15:52 2020 kern.err kernel: [ 1681.861505] mptcp_del_sock: Removing subsock tok 0xfab8f55e pi:1 state 7 is_meta? 0 Sun Oct 4 07:15:52 2020 kern.err kernel: [ 1681.900382] mptcp_del_sock: Removing subsock tok 0xfab8f55e pi:3 state 7 is_meta? 0 Sun Oct 4 07:15:52 2020 kern.err kernel: [ 1681.900462] mptcp_sock_destruct destroying meta-sk token 0xfab8f55e Sun Oct 4 07:15:53 2020 kern.err kernel: [ 1682.397630] mptcp_del_sock: Removing subsock tok 0x5d13e483 pi:1 state 7 is_meta? 0 Sun Oct 4 07:15:53 2020 kern.err kernel: [ 1682.397715] mptcp_del_sock: Removing subsock tok 0x5d13e483 pi:2 state 7 is_meta? 0 Sun Oct 4 07:15:53 2020 kern.err kernel: [ 1682.397785] mptcp_del_sock: Removing subsock tok 0x5d13e483 pi:3 state 7 is_meta? 0 Sun Oct 4 07:15:53 2020 kern.err kernel: [ 1682.397863] mptcp_add_sock: token 0x5d13e483 pi 1, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:15:53 2020 kern.err kernel: [ 1682.397933] mptcp_init4_subsockets: token 0x5d13e483 pi 1 src_addr:192.168.42.29:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 41 Sun Oct 4 07:15:53 2020 kern.err kernel: [ 1682.398048] mptcp_add_sock: token 0x5d13e483 pi 2, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:15:53 2020 kern.err kernel: [ 1682.398118] mptcp_init4_subsockets: token 0x5d13e483 pi 2 src_addr:192.168.20.243:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 11 Sun Oct 4 07:15:53 2020 kern.err kernel: [ 1682.398219] mptcp_add_sock: token 0x5d13e483 pi 3, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:15:53 2020 kern.err kernel: [ 1682.398734] __mptcp_init4_subsockets: token 0x5d13e483 pi 3 src_addr:192.168.42.117:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 38 Sun Oct 4 07:15:57 2020 kern.err kernel: [ 1686.590407] mptcp_close: Close of meta_sk with tok 0x65456aeb Sun Oct 4 07:15:57 2020 kern.err kernel: [ 1686.610259] mptcp_del_sock: Removing subsock tok 0x65456aeb pi:2 state 7 is_meta? 0 Sun Oct 4 07:15:57 2020 kern.err kernel: [ 1686.610349] mptcp_del_sock: Removing subsock tok 0x65456aeb pi:1 state 7 is_meta? 0 Sun Oct 4 07:15:57 2020 kern.err kernel: [ 1686.650097] mptcp_del_sock: Removing subsock tok 0x65456aeb pi:3 state 7 is_meta? 0 Sun Oct 4 07:15:57 2020 kern.err kernel: [ 1686.650174] mptcp_sock_destruct destroying meta-sk token 0x65456aeb Sun Oct 4 07:16:01 2020 kern.err kernel: [ 1690.589456] mptcp_del_sock: Removing subsock tok 0x733f8d2f pi:2 state 7 is_meta? 0 Sun Oct 4 07:16:01 2020 kern.err kernel: [ 1690.589550] mptcp_add_sock: token 0x733f8d2f pi 2, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:16:01 2020 kern.err kernel: [ 1690.589623] mptcp_init4_subsockets: token 0x733f8d2f pi 2 src_addr:192.168.42.29:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 41 Sun Oct 4 07:16:01 2020 kern.err kernel: [ 1690.666405] mptcp_alloc_mpcb: created mpcb with token 0x14684151 Sun Oct 4 07:16:01 2020 kern.err kernel: [ 1690.666466] mptcp_add_sock: token 0x14684151 pi 1, src_addr:192.168.42.117:63695 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 Sun Oct 4 07:16:01 2020 kern.err kernel: [ 1690.753544] mptcp_add_sock: token 0x14684151 pi 2, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:16:01 2020 kern.err kernel: [ 1690.753638] mptcp_init4_subsockets: token 0x14684151 pi 2 src_addr:192.168.42.29:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 41 Sun Oct 4 07:16:01 2020 kern.err kernel: [ 1690.753772] mptcp_add_sock: token 0x14684151 pi 3, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:16:01 2020 kern.err kernel: [ 1690.753842] mptcp_init4_subsockets: token 0x14684151 pi 3 src_addr:192.168.20.243:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 11 Sun Oct 4 07:16:02 2020 kern.err kernel: [ 1691.554027] mptcp_close: Close of meta_sk with tok 0xfdfe0c2d Sun Oct 4 07:16:02 2020 kern.err kernel: [ 1691.556278] mptcp_close: Close of meta_sk with tok 0x2b3a5e79 Sun Oct 4 07:16:02 2020 kern.err kernel: [ 1691.687283] mptcp_del_sock: Removing subsock tok 0x2b3a5e79 pi:2 state 7 is_meta? 0 Sun Oct 4 07:16:02 2020 kern.err kernel: [ 1691.698638] mptcp_close: Close of meta_sk with tok 0x14954749 Sun Oct 4 07:16:02 2020 kern.err kernel: [ 1691.707275] mptcp_del_sock: Removing subsock tok 0xfdfe0c2d pi:2 state 7 is_meta? 0 Sun Oct 4 07:16:02 2020 kern.err kernel: [ 1691.767378] mptcp_del_sock: Removing subsock tok 0x2b3a5e79 pi:1 state 7 is_meta? 0 Sun Oct 4 07:16:02 2020 kern.err kernel: [ 1691.767461] mptcp_sock_destruct destroying meta-sk token 0x2b3a5e79 Sun Oct 4 07:16:02 2020 kern.err kernel: [ 1691.846136] mptcp_del_sock: Removing subsock tok 0x14954749 pi:2 state 7 is_meta? 0 Sun Oct 4 07:16:03 2020 kern.err kernel: [ 1692.637446] mptcp_del_sock: Removing subsock tok 0x28fe9f3b pi:2 state 7 is_meta? 0 Sun Oct 4 07:16:03 2020 kern.err kernel: [ 1692.637541] mptcp_add_sock: token 0x28fe9f3b pi 2, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:16:03 2020 kern.err kernel: [ 1692.637613] mptcp_init4_subsockets: token 0x28fe9f3b pi 2 src_addr:192.168.42.29:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 41 Sun Oct 4 07:16:03 2020 kern.err kernel: [ 1692.729867] mptcp_del_sock: Removing subsock tok 0xfdfe0c2d pi:1 state 7 is_meta? 0 Sun Oct 4 07:16:03 2020 kern.err kernel: [ 1692.729978] mptcp_sock_destruct destroying meta-sk token 0xfdfe0c2d Sun Oct 4 07:16:03 2020 kern.err kernel: [ 1692.730067] mptcp_del_sock: Removing subsock tok 0x14954749 pi:1 state 7 is_meta? 0 Sun Oct 4 07:16:03 2020 kern.err kernel: [ 1692.730205] mptcp_sock_destruct destroying meta-sk token 0x14954749 Sun Oct 4 07:16:03 2020 kern.err kernel: [ 1692.893405] mptcp_del_sock: Removing subsock tok 0x5d13e483 pi:3 state 7 is_meta? 0 Sun Oct 4 07:16:03 2020 kern.err kernel: [ 1692.893491] mptcp_del_sock: Removing subsock tok 0x5d13e483 pi:2 state 7 is_meta? 0 Sun Oct 4 07:16:03 2020 kern.err kernel: [ 1692.893560] mptcp_del_sock: Removing subsock tok 0x5d13e483 pi:1 state 7 is_meta? 0 Sun Oct 4 07:16:03 2020 kern.err kernel: [ 1692.893761] mptcp_close: Close of meta_sk with tok 0x5d13e483 Sun Oct 4 07:16:03 2020 kern.err kernel: [ 1692.893818] mptcp_sock_destruct destroying meta-sk token 0x5d13e483 Sun Oct 4 07:16:09 2020 kern.err kernel: [ 1699.140117] mptcp_alloc_mpcb: created mpcb with token 0x21813910 Sun Oct 4 07:16:09 2020 kern.err kernel: [ 1699.140178] mptcp_add_sock: token 0x21813910 pi 1, src_addr:192.168.42.117:63703 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 Sun Oct 4 07:16:09 2020 kern.err kernel: [ 1699.218386] mptcp_add_sock: token 0x21813910 pi 2, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:16:09 2020 kern.err kernel: [ 1699.218470] mptcp_init4_subsockets: token 0x21813910 pi 2 src_addr:192.168.42.29:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 41 Sun Oct 4 07:16:09 2020 kern.err kernel: [ 1699.218579] mptcp_add_sock: token 0x21813910 pi 3, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:16:09 2020 kern.err kernel: [ 1699.218647] mptcp_init4_subsockets: token 0x21813910 pi 3 src_addr:192.168.20.243:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 11 Sun Oct 4 07:16:11 2020 kern.err kernel: [ 1700.573260] mptcp_del_sock: Removing subsock tok 0x14684151 pi:2 state 7 is_meta? 0 Sun Oct 4 07:16:11 2020 kern.err kernel: [ 1700.573346] mptcp_add_sock: token 0x14684151 pi 2, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:16:11 2020 kern.err kernel: [ 1700.573417] mptcp_init4_subsockets: token 0x14684151 pi 2 src_addr:192.168.42.29:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 41 Sun Oct 4 07:16:11 2020 kern.err kernel: [ 1700.756389] mptcp_alloc_mpcb: created mpcb with token 0xb5dd3f6d Sun Oct 4 07:16:11 2020 kern.err kernel: [ 1700.756449] mptcp_add_sock: token 0xb5dd3f6d pi 1, src_addr:192.168.42.117:63709 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 Sun Oct 4 07:16:11 2020 kern.err kernel: [ 1700.826129] mptcp_add_sock: token 0xb5dd3f6d pi 2, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:16:11 2020 kern.err kernel: [ 1700.826210] mptcp_init4_subsockets: token 0xb5dd3f6d pi 2 src_addr:192.168.42.29:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 41 Sun Oct 4 07:16:11 2020 kern.err kernel: [ 1700.826326] mptcp_add_sock: token 0xb5dd3f6d pi 3, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:16:11 2020 kern.err kernel: [ 1700.826395] __mptcp_init4_subsockets: token 0xb5dd3f6d pi 3 src_addr:192.168.20.243:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 11 Sun Oct 4 07:16:12 2020 kern.err kernel: [ 1701.470170] mptcp_alloc_mpcb: created mpcb with token 0xcb5f3a54 Sun Oct 4 07:16:12 2020 kern.err kernel: [ 1701.470231] mptcp_add_sock: token 0xcb5f3a54 pi 1, src_addr:192.168.42.117:63717 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 Sun Oct 4 07:16:12 2020 kern.err kernel: [ 1701.470355] mptcp_alloc_mpcb: created mpcb with token 0x821a8ab1 Sun Oct 4 07:16:12 2020 kern.err kernel: [ 1701.470413] mptcp_add_sock: token 0x821a8ab1 pi 1, src_addr:192.168.42.117:63721 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 Sun Oct 4 07:16:12 2020 kern.err kernel: [ 1701.564533] mptcp_add_sock: token 0x821a8ab1 pi 2, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:16:12 2020 kern.err kernel: [ 1701.564613] mptcp_init4_subsockets: token 0x821a8ab1 pi 2 src_addr:192.168.42.29:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 41 Sun Oct 4 07:16:12 2020 kern.err kernel: [ 1701.564777] mptcp_add_sock: token 0x821a8ab1 pi 3, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:16:12 2020 kern.err kernel: [ 1701.564848] mptcp_init4_subsockets: token 0x821a8ab1 pi 3 src_addr:192.168.20.243:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 11 Sun Oct 4 07:16:12 2020 kern.err kernel: [ 1701.564960] mptcp_add_sock: token 0xcb5f3a54 pi 2, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:16:12 2020 kern.err kernel: [ 1701.565045] __mptcp_init4_subsockets: token 0xcb5f3a54 pi 2 src_addr:192.168.42.29:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 41 Sun Oct 4 07:16:12 2020 kern.err kernel: [ 1701.565149] mptcp_add_sock: token 0xcb5f3a54 pi 3, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:16:12 2020 kern.err kernel: [ 1701.565233] mptcp_init4_subsockets: token 0xcb5f3a54 pi 3 src_addr:192.168.20.243:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 11 Sun Oct 4 07:16:14 2020 kern.err kernel: [ 1703.901233] mptcp_del_sock: Removing subsock tok 0x15e73c07 pi:1 state 7 is_meta? 0 Sun Oct 4 07:16:14 2020 kern.err kernel: [ 1703.901342] mptcp_add_sock: token 0x15e73c07 pi 1, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:16:14 2020 kern.err kernel: [ 1703.901412] mptcp_init4_subsockets: token 0x15e73c07 pi 1 src_addr:192.168.42.29:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 41 Sun Oct 4 07:16:14 2020 kern.err kernel: [ 1703.901523] mptcp_add_sock: token 0x15e73c07 pi 3, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:16:14 2020 kern.err kernel: [ 1703.901591] __mptcp_init4_subsockets: token 0x15e73c07 pi 3 src_addr:192.168.20.243:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 11 Sun Oct 4 07:16:18 2020 kern.err kernel: [ 1707.573219] mptcp_close: Close of meta_sk with tok 0x14684151 Sun Oct 4 07:16:18 2020 kern.err kernel: [ 1707.592985] mptcp_del_sock: Removing subsock tok 0x14684151 pi:2 state 7 is_meta? 0 Sun Oct 4 07:16:18 2020 kern.err kernel: [ 1707.593075] mptcp_del_sock: Removing subsock tok 0x14684151 pi:1 state 7 is_meta? 0 Sun Oct 4 07:16:18 2020 kern.err kernel: [ 1707.632307] mptcp_del_sock: Removing subsock tok 0x14684151 pi:3 state 7 is_meta? 0 Sun Oct 4 07:16:18 2020 kern.err kernel: [ 1707.632382] mptcp_sock_destruct destroying meta-sk token 0x14684151 Sun Oct 4 07:16:22 2020 kern.err kernel: [ 1711.409163] mptcp_alloc_mpcb: created mpcb with token 0x707a2586 Sun Oct 4 07:16:22 2020 kern.err kernel: [ 1711.409224] mptcp_add_sock: token 0x707a2586 pi 1, src_addr:192.168.42.117:63737 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 Sun Oct 4 07:16:22 2020 kern.err kernel: [ 1711.483596] mptcp_add_sock: token 0x707a2586 pi 2, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:16:22 2020 kern.err kernel: [ 1711.483677] mptcp_init4_subsockets: token 0x707a2586 pi 2 src_addr:192.168.42.29:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 41 Sun Oct 4 07:16:22 2020 kern.err kernel: [ 1711.483816] mptcp_add_sock: token 0x707a2586 pi 3, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:16:22 2020 kern.err kernel: [ 1711.483893] mptcp_init4_subsockets: token 0x707a2586 pi 3 src_addr:192.168.20.243:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 11 Sun Oct 4 07:16:24 2020 kern.err kernel: [ 1713.628989] mptcp_del_sock: Removing subsock tok 0x28fe9f3b pi:2 state 7 is_meta? 0 Sun Oct 4 07:16:24 2020 kern.err kernel: [ 1713.629077] mptcp_add_sock: token 0x28fe9f3b pi 2, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:16:24 2020 kern.err kernel: [ 1713.629150] mptcp_init4_subsockets: token 0x28fe9f3b pi 2 src_addr:192.168.42.29:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 41 Sun Oct 4 07:16:27 2020 kern.err kernel: [ 1716.956923] mptcp_del_sock: Removing subsock tok 0x53f81131 pi:1 state 7 is_meta? 0 Sun Oct 4 07:16:27 2020 kern.err kernel: [ 1716.957009] mptcp_add_sock: token 0x53f81131 pi 1, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:16:27 2020 kern.err kernel: [ 1716.957082] mptcp_init4_subsockets: token 0x53f81131 pi 1 src_addr:192.168.42.29:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 41 Sun Oct 4 07:16:27 2020 kern.err kernel: [ 1716.957201] mptcp_add_sock: token 0x53f81131 pi 3, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:16:27 2020 kern.err kernel: [ 1716.957276] mptcp_init4_subsockets: token 0x53f81131 pi 3 src_addr:192.168.20.243:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 11 Sun Oct 4 07:16:32 2020 kern.err kernel: [ 1721.564824] mptcp_del_sock: Removing subsock tok 0x707a2586 pi:2 state 7 is_meta? 0 Sun Oct 4 07:16:32 2020 kern.err kernel: [ 1721.564908] mptcp_add_sock: token 0x707a2586 pi 2, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:16:32 2020 kern.err kernel: [ 1721.564981] mptcp_init4_subsockets: token 0x707a2586 pi 2 src_addr:192.168.42.29:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 41 Sun Oct 4 07:16:35 2020 kern.err kernel: [ 1724.558417] mptcp_close: Close of meta_sk with tok 0x53f81131 Sun Oct 4 07:16:35 2020 kern.err kernel: [ 1724.598141] mptcp_del_sock: Removing subsock tok 0x53f81131 pi:3 state 7 is_meta? 0 Sun Oct 4 07:16:35 2020 kern.err kernel: [ 1724.636769] mptcp_del_sock: Removing subsock tok 0xa6672039 pi:1 state 7 is_meta? 0 Sun Oct 4 07:16:35 2020 kern.err kernel: [ 1724.636861] mptcp_add_sock: token 0xa6672039 pi 1, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:16:35 2020 kern.err kernel: [ 1724.636932] mptcp_init4_subsockets: token 0xa6672039 pi 1 src_addr:192.168.42.29:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 41 Sun Oct 4 07:16:35 2020 kern.err kernel: [ 1724.637042] mptcp_add_sock: token 0xa6672039 pi 3, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:16:35 2020 kern.err kernel: [ 1724.637113] mptcp_init4_subsockets: token 0xa6672039 pi 3 src_addr:192.168.20.243:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 11 Sun Oct 4 07:16:35 2020 kern.err kernel: [ 1724.652231] mptcp_del_sock: Removing subsock tok 0x53f81131 pi:2 state 7 is_meta? 0 Sun Oct 4 07:16:35 2020 kern.err kernel: [ 1724.749076] mptcp_del_sock: Removing subsock tok 0x53f81131 pi:1 state 7 is_meta? 0 Sun Oct 4 07:16:35 2020 kern.err kernel: [ 1724.749169] mptcp_sock_destruct destroying meta-sk token 0x53f81131 Sun Oct 4 07:16:37 2020 kern.err kernel: [ 1726.684729] mptcp_del_sock: Removing subsock tok 0x707a2586 pi:2 state 7 is_meta? 0 Sun Oct 4 07:16:37 2020 kern.err kernel: [ 1726.685252] mptcp_add_sock: token 0x707a2586 pi 2, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:16:37 2020 kern.err kernel: [ 1726.685322] mptcp_init4_subsockets: token 0x707a2586 pi 2 src_addr:192.168.42.29:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 41 Sun Oct 4 07:16:42 2020 kern.err kernel: [ 1731.548629] mptcp_del_sock: Removing subsock tok 0x6b750c89 pi:1 state 7 is_meta? 0 Sun Oct 4 07:16:42 2020 kern.err kernel: [ 1731.548717] mptcp_add_sock: token 0x6b750c89 pi 1, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:16:42 2020 kern.err kernel: [ 1731.548788] mptcp_init4_subsockets: token 0x6b750c89 pi 1 src_addr:192.168.42.29:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 41 Sun Oct 4 07:16:42 2020 kern.err kernel: [ 1731.548904] mptcp_add_sock: token 0x6b750c89 pi 3, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:16:42 2020 kern.err kernel: [ 1731.548984] mptcp_init4_subsockets: token 0x6b750c89 pi 3 src_addr:192.168.20.243:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 11 Sun Oct 4 07:16:43 2020 kern.err kernel: [ 1733.336270] mptcp_alloc_mpcb: created mpcb with token 0x8d8c99c4 Sun Oct 4 07:16:43 2020 kern.err kernel: [ 1733.336330] mptcp_add_sock: token 0x8d8c99c4 pi 1, src_addr:192.168.42.117:63753 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 Sun Oct 4 07:16:44 2020 kern.err kernel: [ 1733.418029] mptcp_add_sock: token 0x8d8c99c4 pi 2, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:16:44 2020 kern.err kernel: [ 1733.418112] mptcp_init4_subsockets: token 0x8d8c99c4 pi 2 src_addr:192.168.42.29:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 41 Sun Oct 4 07:16:44 2020 kern.err kernel: [ 1733.418220] mptcp_add_sock: token 0x8d8c99c4 pi 3, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:16:44 2020 kern.err kernel: [ 1733.418292] mptcp_init4_subsockets: token 0x8d8c99c4 pi 3 src_addr:192.168.20.243:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 11 Sun Oct 4 07:16:44 2020 kern.err kernel: [ 1733.672829] mptcp_close: Close of meta_sk with tok 0xb5dd3f6d Sun Oct 4 07:16:44 2020 kern.err kernel: [ 1733.692261] mptcp_del_sock: Removing subsock tok 0xb5dd3f6d pi:2 state 7 is_meta? 0 Sun Oct 4 07:16:44 2020 kern.err kernel: [ 1733.692354] mptcp_del_sock: Removing subsock tok 0xb5dd3f6d pi:1 state 7 is_meta? 0 Sun Oct 4 07:16:44 2020 kern.err kernel: [ 1733.731091] mptcp_del_sock: Removing subsock tok 0xb5dd3f6d pi:3 state 7 is_meta? 0 Sun Oct 4 07:16:44 2020 kern.err kernel: [ 1733.731169] mptcp_sock_destruct destroying meta-sk token 0xb5dd3f6d Sun Oct 4 07:16:44 2020 kern.err kernel: [ 1733.851069] mptcp_alloc_mpcb: created mpcb with token 0xd8ec16e4 Sun Oct 4 07:16:44 2020 kern.err kernel: [ 1733.851131] mptcp_add_sock: token 0xd8ec16e4 pi 1, src_addr:192.168.42.117:63757 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 Sun Oct 4 07:16:44 2020 kern.err kernel: [ 1733.921975] mptcp_add_sock: token 0xd8ec16e4 pi 2, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:16:44 2020 kern.err kernel: [ 1733.922085] __mptcp_init4_subsockets: token 0xd8ec16e4 pi 2 src_addr:192.168.42.29:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 41 Sun Oct 4 07:16:44 2020 kern.err kernel: [ 1733.922223] mptcp_add_sock: token 0xd8ec16e4 pi 3, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:16:44 2020 kern.err kernel: [ 1733.922305] mptcp_init4_subsockets: token 0xd8ec16e4 pi 3 src_addr:192.168.20.243:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 11 Sun Oct 4 07:16:45 2020 kern.err kernel: [ 1734.364571] mptcp_del_sock: Removing subsock tok 0x28fe9f3b pi:2 state 7 is_meta? 0 Sun Oct 4 07:16:45 2020 kern.err kernel: [ 1734.364659] mptcp_add_sock: token 0x28fe9f3b pi 2, src_addr:0.0.0.0:0 dst_addr:0.0.0.0:0 Sun Oct 4 07:16:45 2020 kern.err kernel: [ 1734.364732] mptcp_init4_subsockets: token 0x28fe9f3b pi 2 src_addr:192.168.42.29:0 dst_addr:vps_server: xxx.xxx.xxx.xxx:65101 ifidx: 41 Sun Oct 4 07:16:45 2020 kern.err kernel: [ 1734.395076] mptcp_close: Close of meta_sk with tok 0xcb5f3a54 Sun Oct 4 07:16:45 2020 kern.err kernel: [ 1734.396657] mptcp_close: Close of meta_sk with tok 0x821a8ab1 Sun Oct 4 07:16:45 2020 kern.err kernel: [ 1734.414413] mptcp_del_sock: Removing subsock tok 0xcb5f3a54 pi:2 state 7 is_meta? 0 Sun Oct 4 07:16:45 2020 kern.err kernel: [ 1734.414504] mptcp_del_sock: Removing subsock tok 0xcb5f3a54 pi:1 state 7 is_meta? 0 Sun Oct 4 07:16:45 2020 kern.err kernel: [ 1734.416389] mptcp_del_sock: Removing subsock tok 0x821a8ab1 pi:2 state 7 is_meta? 0 Sun Oct 4 07:16:45 2020 kern.err kernel: [ 1734.416478] mptcp_del_sock: Removing subsock tok 0x821a8ab1 pi:1 state 7 is_meta? 0 Sun Oct 4 07:16:45 2020 kern.err kernel: [ 1734.453247] mptcp_del_sock: Removing subsock tok 0xcb5f3a54 pi:3 state 7 is_meta? 0 Sun Oct 4 07:16:45 2020 kern.err kernel: [ 1734.453329] mptcp_sock_destruct destroying meta-sk token 0xcb5f3a54 Sun Oct 4 07:16:45 2020 kern.err kernel: [ 1734.457358] mptcp_del_sock: Removing subsock tok 0x821a8ab1 pi:3 state 7 is_meta? 0 Sun Oct 4 07:16:45 2020 kern.err kernel: [ 1734.457427] mptcp_sock_destruct destroying meta-sk token 0x821a8ab1
Without having analyzed the logs, do you monitor the OMR status page in parallel to the errors? This sounds like similar problems I have encountered. I've also done some tests in different constellations and had that feeling of randomness. As far as I can tell, the status of the network interface does matter and relate to the described behaviour (gateway down, no IP ( link ), cant reach dns etc.). Perhaps Ysurac has some more details on this.
Without having analyzed the logs, do you monitor the OMR status page in parallel to the errors? This sounds like similar problems I have encountered. I've also done some tests in different constellations and had that feeling of randomness. As far as I can tell, the status of the network interface does matter and relate to the described behaviour (gateway down, no IP ( link ), cant reach dns etc.). Perhaps Ysurac has some more details on this.
Hello, thank you. I will try to monitor in parallel OMR.
The only relevant informations I see on the last logs are relative to the stopped vpn connection tun0 Sun Oct 4 07:00:09 2020 user.notice post-tracking-post-tracking: omrvpn down because gateway down Sun Oct 4 07:00:09 2020 user.notice post-tracking-post-tracking: Tunnel down use ShadowSocks for UDP Sun Oct 4 07:00:09 2020 user.notice Shadowsocks: Rules DOWN Sun Oct 4 07:00:09 2020 daemon.err glorytun[7682]: write: Operation timed out Sun Oct 4 07:00:09 2020 daemon.info glorytun[7682]: STOPPED tun0
°°°°°°°°°°°°°°°°°°°°°°°°°°° Sun Oct 4 07:00:09 2020 daemon.err omr-tracker[12617]: Another app is currently holding the xtables lock. Perhaps you want to use the -w option? Sun Oct 4 07:00:09 2020 user.notice Shadowsocks: Rules UP Sun Oct 4 07:00:09 2020 kern.err kernel: [ 739.223244] mptcp_alloc_mpcb: created mpcb with token 0xa96a2273 Sun Oct 4 07:00:09 2020 kern.err kernel: [ 739.223305] mptcp_add_sock: token 0xa96a2273 pi 1, src_addr:192.168.42.29:15905 dst_addr:vps_server: xxx.xxx.xxx.xxx:65500 °°°°°°°°°°°°°°°°°°°°°°°°°°°
Without having analyzed the logs, do you monitor the OMR status page in parallel to the errors? This sounds like similar problems I have encountered. I've also done some tests in different constellations and had that feeling of randomness. As far as I can tell, the status of the network interface does matter and relate to the described behaviour (gateway down, no IP ( link ), cant reach dns etc.). Perhaps Ysurac has some more details on this.
Also.. I'm thinking to change the laptop computer host where is running the openmptcrouter , testing it on a certified hardware server like an hold DELL T310 with no usb/ethernet adapter ....only for test.. because a dual xeon cpu is a little power expensive for a system like this.
Without having analyzed the logs, do you monitor the OMR status page in parallel to the errors? This sounds like similar problems I have encountered. I've also done some tests in different constellations and had that feeling of randomness. As far as I can tell, the status of the network interface does matter and relate to the described behaviour (gateway down, no IP ( link ), cant reach dns etc.). Perhaps Ysurac has some more details on this.
I'm becoming crazy, where to se the OMR status page?
I'm experiencing really random redundant upload connection.. i disconnect and reconnect a device..it sometimes restart redundancy or not.. or could be.. if not restart.. that I connect the ethernet cable... and it start the redundancy on the ethernet and old one where was not starting....
I have tried to enlarge and reduce OMR ping timeout/retry etc value.. changing from ping to httping or dns.. without results
completely random!
As I already said, same gateway IP for usb1 and usb2 is not a good idea.
Hello, as indicated in the logs, i'm using 3 different gateways. 2 LTE with different operators and 1 lan cable.
So there is a problem somewhere: Set server vps (vps_server: xxx.xxx.xxx.xxx) default route vps_server: xxx.xxx.xxx.xxx nexthop via 192.168.42.129 dev usb0 weight 1 nexthop via 192.168.42.129 dev usb1 weight 1 nexthop via 192.168.20.1 dev eth1 weight 1
So there is a problem somewhere:
Set server vps (vps_server: xxx.xxx.xxx.xxx) default route vps_server: xxx.xxx.xxx.xxx nexthop via 192.168.42.129 dev usb0 weight 1 nexthop via 192.168.42.129 dev usb1 weight 1 nexthop via 192.168.20.1 dev eth1 weight 1
obviously xxx.xxx.xxx.xxx is my datacenter server ip obfuscated...
It's why I'm talking about gateway...
It's why I'm talking about gateway...
What you mean? SIM 1 - gateway assigned by the mobile isp SIM 2 - gateway assigned by the mobile isp Ethernet wan 1 - Assigned by the router (192.168.20.1)
As you can see, usb0 and usb1 use same 192.168.42.129 gateway, you said you use 3 differents gateway. Also route configuration is strange, this is like if there is no defined master connection: weight shoudldn't be all the same.
The only observation I can do , it that the two LTE phones connected as usb tethering from android , are receiving as default, the same usb/lan tethering subnet/broadcast, but the WAN IP is different.
root@OpenMPTCProuter:~# ifconfig
eth0 Link encap:Ethernet HWaddr C8:0A:A9:2B:DE:0C
inet addr:192.168.100.1 Bcast:192.168.100.255 Mask:255.255.255.0
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:505868 errors:0 dropped:0 overruns:0 frame:0
TX packets:267502 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:601462300 (573.5 MiB) TX bytes:28222804 (26.9 MiB)
eth1 Link encap:Ethernet HWaddr 00:E0:4C:35:7A:A5
inet addr:192.168.20.244 Bcast:192.168.20.255 Mask:255.255.255.0
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:372142 errors:0 dropped:0 overruns:0 frame:0
TX packets:517761 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:100
RX bytes:30036305 (28.6 MiB) TX bytes:412525260 (393.4 MiB)
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:65536 Metric:1
RX packets:549732 errors:0 dropped:0 overruns:0 frame:0
TX packets:549732 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:613246742 (584.8 MiB) TX bytes:613246742 (584.8 MiB)
tun0 Link encap:UNSPEC HWaddr 00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00
inet addr:10.255.255.2 P-t-P:10.255.255.1 Mask:255.255.255.255
UP POINTOPOINT RUNNING NOARP MULTICAST MTU:1500 Metric:1
RX packets:175 errors:0 dropped:0 overruns:0 frame:0
TX packets:156 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:33653 (32.8 KiB) TX bytes:12810 (12.5 KiB)
usb0 Link encap:Ethernet HWaddr 6A:CD:45:95:B7:E7
inet addr:192.168.42.117 Bcast:192.168.42.255 Mask:255.255.255.0
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:189364 errors:0 dropped:0 overruns:0 frame:0
TX packets:356977 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:100
RX bytes:15374525 (14.6 MiB) TX bytes:306489665 (292.2 MiB)
usb1 Link encap:Ethernet HWaddr 32:CE:82:29:56:22
inet addr:192.168.42.29 Bcast:192.168.42.255 Mask:255.255.255.0
UP BROADCAST RUNNING MULTICAST MTU:1400 Metric:1
RX packets:197878 errors:28 dropped:0 overruns:0 frame:28
TX packets:338181 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:100
RX bytes:17524690 (16.7 MiB) TX bytes:289634251 (276.2 MiB)
As you can see, usb0 and usb1 use same 192.168.42.129 gateway, you said you use 3 differents gateway. Also route configuration is strange, this is like if there is no defined master connection: weight shoudldn't be all the same.
This could be a really bad problem:
"Unfortunately, there is no way to change the IP address range for the builtin tethering support, even in CyanogenMod. The Wi-Fi hotspot IP is hardcoded in android.net.wifi.WifiStateMachine.startTethering(); the USB tethering IP is hardcoded in com.android.server.connectivity.Tethering"
ok, but I had no idea that this was tethering and you said gateway was not the same. You can still try with only 2 connections (only one tethering) and check if same issue. Also set one connection as master as I said.
ok, but I had no idea that this was tethering and you said gateway was not the same. You can still try with only 2 connections (only one tethering) and check if same issue. Also set one connection as master as I said.
With only 1 lte tethering and wan cable appear to work... but my question is.. what happen with LTE usb key that are working with embed virtual lan that usually are all on 192.168.1.0/24 networks?
This is a really big limit don't distinguish that a same subnet is coming from different devices...
This should work with USB dongle, there is no such limit. Only a limit if it's same physical network.
...Connected a USB dongle at the system boot.. The router replaced the previous wan usb device with the lan of the USB stick automatically...
HI need to use the system for live streaming events using LTE usb key.
From my tests the connection switch from one to another data sim or cable connection it's not without interruption. Some packets are lost and some times it employ from 5 to 10 seconds to make the switch... this mean that it's not working in redundant mode, but in aggregation mode.
I need to have the clone of the same signal on all connections in the the tunnel , to not loose in any case the connection.
I'm not understanding how to set this in explicit way. In the control panel the only parameter I see is in the "Master interface selection" with "balance" "Dynamic changes" etc..
But how to set a real realtime backup without loosing 1ms of pachets?
Really thank you.