No interface aggregation on Gateworks Ventana

[ThisIsNotAnAvailableUsername]

Expected Behavior

The communication should be split between all of the 4 cellular interfaces.

Current Behavior

Upon checking the bandwidth (under Network -> MPTCP), and examining tcpdump, it seems that only one interface is actually used (the one configured to be MPTCP master). The following line appears repeatedly in the system logs:

user.notice post-tracking-post-tracking: Can't find omr-tracker-ss, restart omr-tracker...

The Router was configured automatically using the server key.

Specifications

• OpenMPTCProuter version: 0.59.2 alpha
• OpenMPTCProuter VPS version: 0.1029-test
• OpenMPTCProuter VPS provider: on-prem
• OpenMPTCProuter platform: Gateworks Ventana imx6 armv7l

[Ysurac]

All is green in the status page ? Shadowsocks is used as proxy ? It's a custom compilation ?

[JohnTar22]

Hi, It's something we work on together. Yes, all green in status page and shadowsocks is used as proxy. It's a custom compilation exactly as described in the wiki for unsupported platforms. Thanks!

[JohnTar22]

The lab setup now is: Gateworks Ventana GW5410 with Quecetel EC25 as Master LTE Modem. Another USB to ethernet adapter connected to Teltonika RUT955 LTE Router. Another Teltonika RUT240 connected to a free ethernet port on board.

The desired setup is: 6 Mini Pcie LTE modems on board working together with a variety of sim cards from many ISP's.

[Ysurac]

What is the result of uci show openmptcprouter ?

[JohnTar22]

openmptcprouter.settings=settings openmptcprouter.settings.enabled='1' openmptcprouter.settings.sipalg='1' openmptcprouter.settings.master='balancing' openmptcprouter.settings.disable_ipv6='1' openmptcprouter.settings.check_ipv4_website='http://ip.openmptcprouter.com' openmptcprouter.settings.check_ipv6_website='http://ipv6.openmptcprouter.com' openmptcprouter.settings.status_vps_timeout='1' openmptcprouter.settings.status_getip_timeout='1' openmptcprouter.settings.enable_nodelay='1' openmptcprouter.settings.scaling_governor='performance' openmptcprouter.settings.menu='OpenMPTCProuter' openmptcprouter.settings.disableintfrename='1' openmptcprouter.settings.tracebox='0' openmptcprouter.settings.version='-deelop-75694cfc' openmptcprouter.settings.allmptcpovervpn='0' openmptcprouter.settings.serial='0000000000000000' openmptcprouter.settings.mptcpovervpn='wireguard' openmptcprouter.settings.dns64='0' openmptcprouter.settings.proxy='shadowsocks' openmptcprouter.settings.ha='0' openmptcprouter.settings.vpn='glorytun_tcp' openmptcprouter.settings.firstboot='0' openmptcprouter.settings.apilc='1690042643' openmptcprouter.settings.country='world' openmptcprouter.vps=server openmptcprouter.vps.username='openmptcprouter' openmptcprouter.vps.master='1' openmptcprouter.vps.backup='0' openmptcprouter.vps.port='65500' openmptcprouter.vps.set_firewall='0' openmptcprouter.vps.get_config='0' openmptcprouter.vps.current='1' openmptcprouter.vps.password='xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx' openmptcprouter.vps.admin_error='0' openmptcprouter.vps.redirect_ports='0' openmptcprouter.vps.wgkey='xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx' openmptcprouter.vps.pihole='0' openmptcprouter.vps.kernel='6.1.0-10-amd64' openmptcprouter.vps.machine='x86_64' openmptcprouter.vps.omr_version='0.1029-test' openmptcprouter.vps.token_error='1' openmptcprouter.vps.lastchange='1690042649' openmptcprouter.vps.token='xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx' openmptcprouter.vps.ip='xx.xx.xx.xx' openmptcprouter.vps.available_vpn='glorytun_tcp' 'glorytun_udp' 'dsvpn' 'openvpn' 'openvpn_bonding' 'mlvpn' openmptcprouter.omr=router openmptcprouter.omr.ss_sss0='up' openmptcprouter.omr.detected_public_ipv4='xx.xx.xx.xx' openmptcprouter.omr.detected_ss_ipv4='xx.xx.xx.xx' openmptcprouter.wan1=interface openmptcprouter.wan1.multipath='on' openmptcprouter.wan1.metric='3' openmptcprouter.wan1.multipathvpn='0' openmptcprouter.wan1.state='up' openmptcprouter.wan1.publicip='xxx.xxx.xxx.xxx' openmptcprouter.wan1.latency='45' openmptcprouter.wan1.asn='FIXED-IP-ADDRESS-FOR-RSINGEL-APPLICATION' openmptcprouter.wan1.mtu='1500' openmptcprouter.wan1.mptcp_status='MPTCP enabled' openmptcprouter.wan1.latency_previous='35' openmptcprouter.wan1.lc='1690046119' openmptcprouter.wan2=interface openmptcprouter.wan2.multipath='on' openmptcprouter.wan2.metric='4' openmptcprouter.wan2.multipathvpn='0' openmptcprouter.wan2.state='up' openmptcprouter.wan2.publicip='xxx.xxx.xxx.xxx' openmptcprouter.wan2.latency='52' openmptcprouter.wan2.asn='FIXED-IP-ADDRESS-FOR-RSINGEL-APPLICATION' openmptcprouter.wan2.mtu='1500' openmptcprouter.wan2.mptcp_status='MPTCP enabled' openmptcprouter.wan2.manufacturer='huawei' openmptcprouter.wan2.latency_previous='49' openmptcprouter.wan2.lc='1690046206' openmptcprouter.loopback=interface openmptcprouter.loopback.multipath='off' openmptcprouter.loopback.metric='5' openmptcprouter.lan=interface openmptcprouter.lan.multipath='off' openmptcprouter.lan.metric='6' openmptcprouter.lan.multipathvpn='0' openmptcprouter.omrvpn=interface openmptcprouter.omrvpn.multipath='off' openmptcprouter.omrvpn.metric='1200' openmptcprouter.omr6in4=interface openmptcprouter.omr6in4.multipath='off' openmptcprouter.omr6in4.metric='1201' openmptcprouter.latest_versions=latest_versions openmptcprouter.latest_versions.omr='0.59.1-5.15' openmptcprouter.latest_versions.vps='0.1028' openmptcprouter.latest_versions.lc='1690042641' openmptcprouter.wan3=interface openmptcprouter.wan3.multipath='master' openmptcprouter.wan3.metric='7' openmptcprouter.wan3.multipathvpn='0' openmptcprouter.wan3.state='up' openmptcprouter.wan3.publicip='xxx.xxx.xxx.xxx' openmptcprouter.wan3.latency='34' openmptcprouter.wan3.asn='xxxxxxxxx' openmptcprouter.wan3.mtu='1500' openmptcprouter.wan3.mptcp_status='MPTCP enabled' openmptcprouter.wan3.manufacturer='huawei' openmptcprouter.wan3.latency_previous='33' openmptcprouter.wan3.lc='1690046211'

[JohnTar22]

The above example is running 5.15 kernel

[Ysurac]

All seems ok, you can try to run /bin/omr-tracker-ss and check if you have any output error.

[JohnTar22]

nothing happens, no output at all.

[Ysurac]

And no output in logread about tracker ? ps w | grep tracker show trackers ?

[JohnTar22]

ps w | grep tracker: 19424 root 1368 S {omr-tracker} /bin/sh /bin/omr-tracker wan3 19425 root 1368 S {omr-tracker} /bin/sh /bin/omr-tracker wan2 19426 root 1376 S {omr-tracker} /bin/sh /bin/omr-tracker omrvpn 19427 root 1208 S {omr-tracker-ss} /bin/sh /bin/omr-tracker-ss tracker_sss0 20744 root 2100 S /usr/bin/ss-local -c /var/etc/shadowsocks-libev/ss_local.tracker_sss0.json 29397 root 1696 S {omr-tracker} /bin/sh /bin/omr-tracker wan2 29737 root 1176 R grep tracker

logread | grep -i tracker: Jul 22 18:56:17 OpenMPTCProuter user.notice ucitrack: Setting up /etc/config/omr-tracker reload dependency on /etc/config/network Jul 22 18:56:19 OpenMPTCProuter user.notice ucitrack: Setting up /etc/config/omr-tracker reload dependency on /etc/config/shadowsocks-libev Jul 22 18:56:33 OpenMPTCProuter user.notice omr-tracker: Launching... Jul 22 18:56:41 OpenMPTCProuter user.notice omr-tracker: Launched

[JohnTar22]

it's very unstable, sometimes it downloads on 1.0 Mb rate but uploads on 15Mb, sometimes it doesn't work at all, and sometimes the upload and download rates switch places.

[Ysurac]

Can you put more ouput of logread ? Maybe some issue with shadowsocks... 5.15 kernel is not tested, so I have no idea if it work correctly or not, no release based on it will be done. Next release will be based on kernel 6.1.

[JohnTar22]

i'm not sure that Gateworks will release kernel 6.1 for ventana, i can go back to 5.4 and try again. Jul 22 18:56:00 OpenMPTCProuter syslog.info syslogd started: BusyBox v1.36.1 Jul 22 18:56:00 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S13openssl: Generating engines.cnf Jul 22 18:56:00 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S13openssl: Generating providers.cnf Jul 22 18:56:01 OpenMPTCProuter user.notice dnsmasq: DNS rebinding protection is active, will discard upstream RFC1918 responses! Jul 22 18:56:01 OpenMPTCProuter user.notice dnsmasq: Allowing 127.0.0.0/8 responses Jul 22 18:56:01 OpenMPTCProuter user.notice dnsmasq: Allowing RFC1918 responses for domain plex.direct Jul 22 18:56:01 OpenMPTCProuter daemon.info dnsmasq[1]: started, version 2.89 cachesize 1000 Jul 22 18:56:01 OpenMPTCProuter daemon.info dnsmasq[1]: DNS service limited to local subnets Jul 22 18:56:01 OpenMPTCProuter daemon.info dnsmasq[1]: compile time options: IPv6 GNU-getopt no-DBus UBus no-i18n no-IDN DHCP DHCPv6 no-Lua TFTP conntrack ipset nftset auth cryptohash DNSSEC no-ID loop-detect inotify dumpfile Jul 22 18:56:01 OpenMPTCProuter daemon.info dnsmasq[1]: using nameserver 127.0.0.1#5353 Jul 22 18:56:01 OpenMPTCProuter daemon.info dnsmasq[1]: using only locally-known addresses for test Jul 22 18:56:01 OpenMPTCProuter daemon.info dnsmasq[1]: using only locally-known addresses for onion Jul 22 18:56:01 OpenMPTCProuter daemon.info dnsmasq[1]: using only locally-known addresses for localhost Jul 22 18:56:01 OpenMPTCProuter daemon.info dnsmasq[1]: using only locally-known addresses for local Jul 22 18:56:01 OpenMPTCProuter daemon.info dnsmasq[1]: using only locally-known addresses for invalid Jul 22 18:56:01 OpenMPTCProuter daemon.info dnsmasq[1]: using only locally-known addresses for bind Jul 22 18:56:01 OpenMPTCProuter daemon.info dnsmasq[1]: using only locally-known addresses for use-application-dns.net Jul 22 18:56:01 OpenMPTCProuter daemon.info dnsmasq[1]: using only locally-known addresses for lan Jul 22 18:56:01 OpenMPTCProuter daemon.info dnsmasq[1]: using 1 more local addresses Jul 22 18:56:01 OpenMPTCProuter daemon.info dnsmasq[1]: read /etc/hosts - 12 names Jul 22 18:56:01 OpenMPTCProuter daemon.info dnsmasq[1]: read /tmp/hosts/dhcp.cfg01411c - 0 names Jul 22 18:56:01 OpenMPTCProuter authpriv.info dropbear[3272]: Not backgrounding Jul 22 18:56:02 OpenMPTCProuter user.notice firewall.omr-server: Firewall reload, set server part firewall reloading Jul 22 18:56:02 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S19firewall: Failed to parse json data: unexpected character Jul 22 18:56:02 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S19firewall: Failed to parse json data: unexpected character Jul 22 18:56:02 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S19firewall: Failed to parse json data: unexpected character Jul 22 18:56:02 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S19firewall: Failed to parse json data: unexpected character Jul 22 18:56:03 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S19firewall: Failed to parse json data: unexpected character Jul 22 18:56:03 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S19firewall: Failed to parse json data: unexpected character Jul 22 18:56:03 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S19firewall: Failed to parse json data: unexpected character Jul 22 18:56:03 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S19firewall: Include '/etc/firewall.omr-bypass' failed with exit code 1 Jul 22 18:56:03 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S19firewall: Command failed: ubus call service delete { "name": "miniupnpd" } (Not found) Jul 22 18:56:03 OpenMPTCProuter user.notice Shadowsocks: Rules UP Jul 22 18:56:04 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S19firewall: Flush terminated Jul 22 18:56:04 OpenMPTCProuter user.notice Shadowsocks: Reload omr-bypass rules Jul 22 18:56:05 OpenMPTCProuter daemon.notice wpa_supplicant[4307]: Successfully initialized wpa_supplicant Jul 22 18:56:05 OpenMPTCProuter user.notice : Added device handler type: 8021ad Jul 22 18:56:05 OpenMPTCProuter user.notice : Added device handler type: 8021q Jul 22 18:56:05 OpenMPTCProuter user.notice : Added device handler type: macvlan Jul 22 18:56:05 OpenMPTCProuter user.notice : Added device handler type: veth Jul 22 18:56:05 OpenMPTCProuter user.notice : Added device handler type: bridge Jul 22 18:56:05 OpenMPTCProuter user.notice : Added device handler type: Network device Jul 22 18:56:05 OpenMPTCProuter user.notice : Added device handler type: tunnel Jul 22 18:56:07 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S50sqm: Starting SQM script: simple.qos on wwan0, in: 95000 Kbps, out: 95000 Kbps Jul 22 18:56:08 OpenMPTCProuter daemon.warn netifd: You have delegated IPv6-prefixes but haven't assigned them to any interface. Did you forget to set option ip6assign on your lan-interfaces? Jul 22 18:56:08 OpenMPTCProuter daemon.notice netifd: Interface 'lan' is enabled Jul 22 18:56:08 OpenMPTCProuter daemon.notice netifd: Interface 'lan' is setting up now Jul 22 18:56:08 OpenMPTCProuter daemon.notice netifd: Interface 'lan' is now up Jul 22 18:56:08 OpenMPTCProuter daemon.notice netifd: Interface 'loopback' is enabled Jul 22 18:56:08 OpenMPTCProuter daemon.notice netifd: Interface 'loopback' is setting up now Jul 22 18:56:08 OpenMPTCProuter daemon.notice netifd: Interface 'loopback' is now up Jul 22 18:56:08 OpenMPTCProuter daemon.notice netifd: Interface 'wan1' is setting up now Jul 22 18:56:08 OpenMPTCProuter daemon.notice netifd: Interface 'wan2' is enabled Jul 22 18:56:08 OpenMPTCProuter daemon.notice netifd: Interface 'wan3' is enabled Jul 22 18:56:08 OpenMPTCProuter daemon.notice netifd: wan1 (5685): error: couldn't get bus: Could not connect: No such file or directory Jul 22 18:56:08 OpenMPTCProuter daemon.notice netifd: wan1 (5685): Device not managed by ModemManager Jul 22 18:56:08 OpenMPTCProuter daemon.notice netifd: Network device 'lo' link is up Jul 22 18:56:08 OpenMPTCProuter daemon.notice netifd: Interface 'loopback' has link connectivity Jul 22 18:56:08 OpenMPTCProuter daemon.notice netifd: wan1 (5806): stopping network Jul 22 18:56:08 OpenMPTCProuter daemon.notice netifd: wan1 (5806): error: couldn't get bus: Could not connect: No such file or directory Jul 22 18:56:08 OpenMPTCProuter daemon.notice netifd: wan1 (5806): couldn't load bearer path: disconnecting anyway Jul 22 18:56:08 OpenMPTCProuter daemon.notice netifd: Interface 'wan1' is now down Jul 22 18:56:09 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S50sqm: simple.qos was started on wwan0 successfully Jul 22 18:56:09 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S50sqm: Starting SQM script: simple.qos on eth1, in: 0 Kbps, out: 0 Kbps Jul 22 18:56:09 OpenMPTCProuter daemon.info dnsmasq[1]: exiting on receipt of SIGTERM Jul 22 18:56:09 OpenMPTCProuter daemon.notice netifd: Network device 'eth1' link is up Jul 22 18:56:09 OpenMPTCProuter daemon.notice netifd: Interface 'wan2' has link connectivity Jul 22 18:56:09 OpenMPTCProuter daemon.notice netifd: Interface 'wan2' is setting up now Jul 22 18:56:10 OpenMPTCProuter daemon.info dnsmasq[1]: started, version 2.89 cachesize 1000 Jul 22 18:56:10 OpenMPTCProuter daemon.info dnsmasq[1]: DNS service limited to local subnets Jul 22 18:56:10 OpenMPTCProuter daemon.info dnsmasq[1]: compile time options: IPv6 GNU-getopt no-DBus UBus no-i18n no-IDN DHCP DHCPv6 no-Lua TFTP conntrack ipset nftset auth cryptohash DNSSEC no-ID loop-detect inotify dumpfile Jul 22 18:56:10 OpenMPTCProuter daemon.info dnsmasq-dhcp[1]: DHCP, IP range 192.168.100.100 -- 192.168.100.249, lease time 12h Jul 22 18:56:10 OpenMPTCProuter daemon.info dnsmasq[1]: using nameserver 127.0.0.1#5353 Jul 22 18:56:10 OpenMPTCProuter daemon.info dnsmasq[1]: using only locally-known addresses for test Jul 22 18:56:10 OpenMPTCProuter daemon.info dnsmasq[1]: using only locally-known addresses for onion Jul 22 18:56:10 OpenMPTCProuter daemon.info dnsmasq[1]: using only locally-known addresses for localhost Jul 22 18:56:10 OpenMPTCProuter daemon.info dnsmasq[1]: using only locally-known addresses for local Jul 22 18:56:10 OpenMPTCProuter daemon.info dnsmasq[1]: using only locally-known addresses for invalid Jul 22 18:56:10 OpenMPTCProuter daemon.info dnsmasq[1]: using only locally-known addresses for bind Jul 22 18:56:10 OpenMPTCProuter daemon.info dnsmasq[1]: using only locally-known addresses for use-application-dns.net Jul 22 18:56:10 OpenMPTCProuter daemon.info dnsmasq[1]: using only locally-known addresses for lan Jul 22 18:56:10 OpenMPTCProuter daemon.info dnsmasq[1]: using 1 more local addresses Jul 22 18:56:10 OpenMPTCProuter daemon.info dnsmasq[1]: read /etc/hosts - 12 names Jul 22 18:56:10 OpenMPTCProuter daemon.info dnsmasq[1]: read /tmp/hosts/dhcp.cfg01411c - 2 names Jul 22 18:56:10 OpenMPTCProuter daemon.info dnsmasq-dhcp[1]: read /etc/ethers - 0 addresses Jul 22 18:56:10 OpenMPTCProuter daemon.notice netifd: wan2 (6564): udhcpc: started, v1.36.1 Jul 22 18:56:10 OpenMPTCProuter daemon.notice netifd: wan2 (6564): udhcpc: broadcasting discover Jul 22 18:56:10 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S50sqm: simple.qos was started on eth1 successfully Jul 22 18:56:10 OpenMPTCProuter daemon.notice netifd: Network device 'eth2' link is up Jul 22 18:56:10 OpenMPTCProuter daemon.notice netifd: Interface 'wan3' has link connectivity Jul 22 18:56:10 OpenMPTCProuter daemon.notice netifd: Interface 'wan3' is setting up now Jul 22 18:56:10 OpenMPTCProuter daemon.notice netifd: wan3 (6833): udhcpc: started, v1.36.1 Jul 22 18:56:10 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S50sqm: Starting SQM script: simple.qos on eth2, in: 0 Kbps, out: 0 Kbps Jul 22 18:56:10 OpenMPTCProuter daemon.notice netifd: wan3 (6833): udhcpc: broadcasting discover Jul 22 18:56:11 OpenMPTCProuter daemon.notice netifd: Network device 'eth0' link is up Jul 22 18:56:11 OpenMPTCProuter daemon.notice netifd: Interface 'lan' has link connectivity Jul 22 18:56:11 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S50sqm: simple.qos was started on eth2 successfully Jul 22 18:56:12 OpenMPTCProuter user.notice firewall: Reloading firewall due to ifup of lan (eth0) Jul 22 18:56:13 OpenMPTCProuter daemon.info dnsmasq[1]: read /etc/hosts - 12 names Jul 22 18:56:13 OpenMPTCProuter daemon.info dnsmasq[1]: read /tmp/hosts/dhcp.cfg01411c - 2 names Jul 22 18:56:13 OpenMPTCProuter daemon.info dnsmasq-dhcp[1]: read /etc/ethers - 0 addresses Jul 22 18:56:13 OpenMPTCProuter user.notice firewall.omr-server: Firewall reload, set server part firewall reloading Jul 22 18:56:13 OpenMPTCProuter daemon.notice netifd: wan2 (6564): udhcpc: broadcasting discover Jul 22 18:56:13 OpenMPTCProuter daemon.notice netifd: wan2 (6564): udhcpc: broadcasting select for 192.168.1.17, server 192.168.1.1 Jul 22 18:56:13 OpenMPTCProuter daemon.notice netifd: wan2 (6564): udhcpc: lease of 192.168.1.17 obtained from 192.168.1.1, lease time 43200 Jul 22 18:56:13 OpenMPTCProuter daemon.notice netifd: Interface 'wan2' is now up Jul 22 18:56:13 OpenMPTCProuter daemon.notice netifd: wan3 (6833): udhcpc: broadcasting discover Jul 22 18:56:14 OpenMPTCProuter daemon.notice netifd: wan3 (6833): udhcpc: broadcasting select for 192.168.4.10, server 192.168.4.1 Jul 22 18:56:14 OpenMPTCProuter daemon.notice netifd: wan3 (6833): udhcpc: lease of 192.168.4.10 obtained from 192.168.4.1, lease time 43200 Jul 22 18:56:14 OpenMPTCProuter daemon.notice netifd: Interface 'wan3' is now up Jul 22 18:56:14 OpenMPTCProuter user.notice mptcp: Reloading mptcp config due to ifup of lan (eth0) Jul 22 18:56:15 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S5openmptcprouter: Usage: uci [] [] Jul 22 18:56:15 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S5openmptcprouter: Jul 22 18:56:15 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S5openmptcprouter: Commands: Jul 22 18:56:15 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S5openmptcprouter: batch Jul 22 18:56:15 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S5openmptcprouter: export [] Jul 22 18:56:15 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S5openmptcprouter: import [] Jul 22 18:56:15 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S5openmptcprouter: changes [] Jul 22 18:56:15 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S5openmptcprouter: commit [] Jul 22 18:56:15 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S5openmptcprouter: add Jul 22 18:56:15 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S5openmptcprouter: add_list .

.= Jul 22 18:56:15 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S5openmptcprouter: del_list .

.= Jul 22 18:56:15 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S5openmptcprouter: show [[.

[.]]] Jul 22 18:56:15 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S5openmptcprouter: get .

[.] Jul 22 18:56:15 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S5openmptcprouter: set .

[.]= Jul 22 18:56:15 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S5openmptcprouter: delete [.

[[.][=]]] Jul 22 18:56:15 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S5openmptcprouter: rename .

[.]= Jul 22 18:56:15 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S5openmptcprouter: revert [.

[.]] Jul 22 18:56:15 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S5openmptcprouter: reorder .

= Jul 22 18:56:15 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S5openmptcprouter: Jul 22 18:56:15 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S5openmptcprouter: Options: Jul 22 18:56:15 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S5openmptcprouter: -c set the search path for config files (default: /etc/config) Jul 22 18:56:15 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S5openmptcprouter: -d set the delimiter for list values in uci show Jul 22 18:56:15 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S5openmptcprouter: -f use as input instead of stdin Jul 22 18:56:15 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S5openmptcprouter: -m when importing, merge data into an existing package Jul 22 18:56:15 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S5openmptcprouter: -n name unnamed sections on export (default) Jul 22 18:56:15 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S5openmptcprouter: -N don't name unnamed sections Jul 22 18:56:15 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S5openmptcprouter: -p add a search path for config change files Jul 22 18:56:15 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S5openmptcprouter: -P add a search path for config change files and use as default Jul 22 18:56:15 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S5openmptcprouter: -t set save path for config change files Jul 22 18:56:15 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S5openmptcprouter: -q quiet mode (don't print error messages) Jul 22 18:56:15 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S5openmptcprouter: -s force strict mode (stop on parser errors, default) Jul 22 18:56:15 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S5openmptcprouter: -S disable strict mode Jul 22 18:56:15 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S5openmptcprouter: -X do not use extended syntax on 'show' Jul 22 18:56:15 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S5openmptcprouter: Jul 22 18:56:15 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S5openmptcprouter: /etc/rc.common: line 214: _log: not found Jul 22 18:56:15 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S5openmptcprouter: Command failed: ubus call service delete { "name": "modemmanager" } (Not found) Jul 22 18:56:15 OpenMPTCProuter daemon.info [9087]: ModemManager (version 1.20.4) starting in system bus... Jul 22 18:56:16 OpenMPTCProuter daemon.info vnstatd[9447]: Info: vnStat daemon 2.10 started. (pid:9447 uid:0 gid:0 64-bit) Jul 22 18:56:16 OpenMPTCProuter daemon.info vnstatd[9447]: Info: Monitoring (2): eth2 (100 Mbit) eth1 (100 Mbit) Jul 22 18:56:17 OpenMPTCProuter user.notice ucitrack: Setting up /etc/config/dhcp reload dependency on /etc/config/network Jul 22 18:56:17 OpenMPTCProuter user.notice ucitrack: Setting up /etc/config/glorytun reload dependency on /etc/config/network Jul 22 18:56:17 OpenMPTCProuter user.notice ucitrack: Setting up /etc/config/glorytun-udp reload dependency on /etc/config/network Jul 22 18:56:17 OpenMPTCProuter user.notice ucitrack: Setting up /etc/config/dsvpn reload dependency on /etc/config/network Jul 22 18:56:17 OpenMPTCProuter user.notice ucitrack: Setting up /etc/config/mptcpovervpn reload dependency on /etc/config/network Jul 22 18:56:17 OpenMPTCProuter user.notice ucitrack: Setting up /etc/config/omr6in4 reload dependency on /etc/config/network Jul 22 18:56:17 OpenMPTCProuter user.notice ucitrack: Setting up /etc/config/omr-quota reload dependency on /etc/config/network Jul 22 18:56:17 OpenMPTCProuter user.notice ucitrack: Setting up /etc/config/omr-tracker reload dependency on /etc/config/network Jul 22 18:56:17 OpenMPTCProuter user.notice ucitrack: Setting up /etc/config/openmptcprouter reload dependency on /etc/config/network Jul 22 18:56:17 OpenMPTCProuter user.notice ucitrack: Setting up /etc/config/network reload dependency on /etc/config/wireless Jul 22 18:56:17 OpenMPTCProuter user.notice ucitrack: Setting up /etc/config/luci-splash reload dependency on /etc/config/firewall Jul 22 18:56:17 OpenMPTCProuter user.notice ucitrack: Setting up /etc/config/qos reload dependency on /etc/config/firewall Jul 22 18:56:17 OpenMPTCProuter user.notice ucitrack: Setting up /etc/config/miniupnpd reload dependency on /etc/config/firewall Jul 22 18:56:17 OpenMPTCProuter user.notice ucitrack: Setting up /etc/config/sqm reload dependency on /etc/config/firewall Jul 22 18:56:17 OpenMPTCProuter user.notice ucitrack: Setting up /etc/config/sqm-autorate reload dependency on /etc/config/firewall Jul 22 18:56:17 OpenMPTCProuter user.notice ucitrack: Setting up /etc/config/odhcpd reload dependency on /etc/config/dhcp Jul 22 18:56:18 OpenMPTCProuter user.notice ucitrack: Setting up non-init /etc/config/fstab reload handler: /sbin/block mount Jul 22 18:56:18 OpenMPTCProuter user.notice mptcp: Reloading mptcp config due to ifup of loopback (lo) Jul 22 18:56:18 OpenMPTCProuter user.notice ucitrack: Setting up /etc/config/system reload trigger for non-procd /etc/init.d/led Jul 22 18:56:18 OpenMPTCProuter user.notice ucitrack: Setting up /etc/config/luci_statistics reload dependency on /etc/config/system Jul 22 18:56:18 OpenMPTCProuter user.notice ucitrack: Setting up /etc/config/dhcp reload dependency on /etc/config/system Jul 22 18:56:18 OpenMPTCProuter user.notice ucitrack: Setting up /etc/config/glorytun-udp reload dependency on /etc/config/glorytun Jul 22 18:56:18 OpenMPTCProuter user.notice ucitrack: Setting up /etc/config/openmptcprouter-vps reload dependency on /etc/config/glorytun Jul 22 18:56:18 OpenMPTCProuter user.notice unbound: default memory configuration Jul 22 18:56:18 OpenMPTCProuter user.notice ucitrack: Setting up /etc/config/openmptcprouter-vps reload dependency on /etc/config/glorytun-udp Jul 22 18:56:19 OpenMPTCProuter user.notice ucitrack: Setting up /etc/config/omr-tracker reload dependency on /etc/config/shadowsocks-libev Jul 22 18:56:19 OpenMPTCProuter user.notice ucitrack: Setting up /etc/config/mlvpn reload trigger for non-procd /etc/init.d/mlvpn Jul 22 18:56:19 OpenMPTCProuter daemon.notice unbound: [11115:0] notice: init module 0: validator Jul 22 18:56:19 OpenMPTCProuter daemon.notice unbound: [11115:0] notice: init module 1: iterator Jul 22 18:56:19 OpenMPTCProuter daemon.info unbound: [11115:0] info: start of service (unbound 1.17.1). Jul 22 18:56:20 OpenMPTCProuter daemon.info glorytun: starting glorytun vpn instance vpn Jul 22 18:56:20 OpenMPTCProuter daemon.notice netifd: Interface 'omrvpn' is enabled Jul 22 18:56:20 OpenMPTCProuter daemon.notice netifd: Network device 'tun0' link is up Jul 22 18:56:20 OpenMPTCProuter daemon.notice netifd: Interface 'omrvpn' has link connectivity Jul 22 18:56:20 OpenMPTCProuter daemon.notice netifd: Interface 'omrvpn' is setting up now Jul 22 18:56:20 OpenMPTCProuter daemon.info glorytun[12198]: INITIALIZED tun0 Jul 22 18:56:20 OpenMPTCProuter daemon.notice netifd: Interface 'omrvpn' is now up Jul 22 18:56:25 OpenMPTCProuter daemon.err glorytun[12198]: xx.xx.xx.xx.65001: connected Jul 22 18:56:25 OpenMPTCProuter daemon.err glorytun[12198]: couldn't set socket option TCP_NODELAY' Jul 22 18:56:25 OpenMPTCProuter daemon.err glorytun[12198]: couldn't set socket optionTCP_KEEPCNT' Jul 22 18:56:25 OpenMPTCProuter daemon.err glorytun[12198]: couldn't set socket option TCP_KEEPIDLE' Jul 22 18:56:25 OpenMPTCProuter daemon.err glorytun[12198]: couldn't set socket optionTCP_KEEPINTVL' Jul 22 18:56:25 OpenMPTCProuter daemon.err glorytun[12198]: couldn't set socket option TCP_USER_TIMEOUT' Jul 22 18:56:26 OpenMPTCProuter daemon.warn [9087]: <warn> [ttyUSB0/probe] failed to parse QCDM version info command result: -7 Jul 22 18:56:27 OpenMPTCProuter daemon.info [9087]: <info> [base-manager] couldn't check support for device '/sys/devices/platform/soc/2000000.bus/2090000.can': not supported by any plugin Jul 22 18:56:27 OpenMPTCProuter daemon.info [9087]: <info> [base-manager] couldn't check support for device '/sys/devices/platform/soc/1ffc000.pcie/pci0000:00/0000:00:00.0/0000:01:00.0/0000:02:08.0/0000:08:00.0': not supported by any plugin Jul 22 18:56:27 OpenMPTCProuter daemon.info glorytun[12198]: STARTED tun0 Jul 22 18:56:27 OpenMPTCProuter daemon.info [9087]: <info> [base-manager] couldn't check support for device '/sys/devices/platform/soc/2100000.bus/2184200.usb/ci_hdrc.1/usb1/1-1/1-1.4': not supported by any plugin Jul 22 18:56:28 OpenMPTCProuter daemon.info [9087]: <info> [device /sys/devices/platform/soc/2100000.bus/2184200.usb/ci_hdrc.1/usb1/1-1/1-1.2] creating modem with plugin 'quectel' and '6' ports Jul 22 18:56:28 OpenMPTCProuter daemon.info [9087]: <info> [base-manager] modem for device '/sys/devices/platform/soc/2100000.bus/2184200.usb/ci_hdrc.1/usb1/1-1/1-1.2' successfully created Jul 22 18:56:29 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S90omr-dscp: iptables: No chain/target/match by that name. Jul 22 18:56:29 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S90omr-dscp: iptables: No chain/target/match by that name. Jul 22 18:56:29 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S90omr-dscp: iptables: No chain/target/match by that name. Jul 22 18:56:29 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S90omr-dscp: iptables: No chain/target/match by that name. Jul 22 18:56:29 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S90omr-dscp: iptables: No chain/target/match by that name. Jul 22 18:56:29 OpenMPTCProuter daemon.warn [9087]: <warn> [modem0] couldn't query SIM slots: QMI protocol error (94): 'NotSupported' Jul 22 18:56:30 OpenMPTCProuter daemon.warn [9087]: <warn> [modem0] couldn't load list of own numbers: Couldn't get MSISDN: QMI protocol error (16): 'NotProvisioned' Jul 22 18:56:30 OpenMPTCProuter daemon.info [9087]: <info> [modem0] state changed (unknown -> disabled) Jul 22 18:56:32 OpenMPTCProuter daemon.warn [9087]: <warn> [SQM_IFB_83df1] invalid sysfs path read for net/SQM_IFB_83df1 Jul 22 18:56:32 OpenMPTCProuter daemon.warn [9087]: <warn> [base-manager] couldn't handle kernel event: device net/SQM_IFB_83df1 not found Jul 22 18:56:32 OpenMPTCProuter daemon.warn [9087]: <warn> [SQM_IFB_84f55] invalid sysfs path read for net/SQM_IFB_84f55 Jul 22 18:56:32 OpenMPTCProuter daemon.warn [9087]: <warn> [base-manager] couldn't handle kernel event: device net/SQM_IFB_84f55 not found Jul 22 18:56:33 OpenMPTCProuter user.notice firewall: Reloading firewall due to ifup of wan2 (eth1) Jul 22 18:56:33 OpenMPTCProuter user.notice omr-tracker: Launching... Jul 22 18:56:33 OpenMPTCProuter daemon.notice netifd: Interface 'wan1' is setting up now Jul 22 18:56:33 OpenMPTCProuter daemon.notice netifd: wan1 (17048): modem available at /org/freedesktop/ModemManager1/Modem/0 Jul 22 18:56:34 OpenMPTCProuter daemon.notice netifd: wan1 (17048): starting connection with apn ''... Jul 22 18:56:34 OpenMPTCProuter daemon.info [9087]: <info> [modem0] simple connect started... Jul 22 18:56:34 OpenMPTCProuter daemon.info [9087]: <info> [modem0] simple connect state (3/10): enable Jul 22 18:56:34 OpenMPTCProuter daemon.info [9087]: <info> [modem0] state changed (disabled -> enabling) Jul 22 18:56:34 OpenMPTCProuter daemon.info [9087]: <info> [modem0] power state updated: on Jul 22 18:56:34 OpenMPTCProuter user.notice firewall.omr-server: Firewall reload, set server part firewall reloading Jul 22 18:56:35 OpenMPTCProuter user.notice mptcp: Reloading mptcp config due to ifup of wan2 (eth1) Jul 22 18:56:37 OpenMPTCProuter daemon.info [9087]: <info> [modem0] simple connect state (4/10): wait to get fully enabled Jul 22 18:56:37 OpenMPTCProuter daemon.info [9087]: <info> [modem0] state changed (enabling -> enabled) Jul 22 18:56:37 OpenMPTCProuter daemon.info [9087]: <info> [modem0] simple connect state (5/10): wait after enabled Jul 22 18:56:37 OpenMPTCProuter daemon.info [9087]: <info> [modem0] 3GPP registration state changed (unknown -> registering) Jul 22 18:56:37 OpenMPTCProuter daemon.info [9087]: <info> [modem0] 3GPP registration state changed (registering -> home) Jul 22 18:56:37 OpenMPTCProuter daemon.info [9087]: <info> [modem0] state changed (enabled -> registered) Jul 22 18:56:37 OpenMPTCProuter daemon.info [9087]: <info> [modem0] simple connect state (6/10): register Jul 22 18:56:37 OpenMPTCProuter daemon.info [9087]: <info> [modem0] simple connect state (7/10): wait to get packet service state attached Jul 22 18:56:37 OpenMPTCProuter daemon.info [9087]: <info> [modem0] simple connect state (8/10): bearer Jul 22 18:56:37 OpenMPTCProuter daemon.info [9087]: <info> [modem0] simple connect state (9/10): connect Jul 22 18:56:37 OpenMPTCProuter daemon.info [9087]: <info> [modem0] state changed (registered -> connecting) Jul 22 18:56:38 OpenMPTCProuter daemon.info [9087]: <info> [modem0/bearer1] QMI IPv4 Settings: Jul 22 18:56:38 OpenMPTCProuter daemon.info [9087]: <info> [modem0/bearer1] address: xx.xx.xx.xx/29 Jul 22 18:56:38 OpenMPTCProuter daemon.info [9087]: <info> [modem0/bearer1] gateway: xx.xx.xx.xx Jul 22 18:56:38 OpenMPTCProuter daemon.info [9087]: <info> [modem0/bearer1] DNS #1: xx.xx.xx.xx Jul 22 18:56:38 OpenMPTCProuter daemon.info [9087]: <info> [modem0/bearer1] DNS #2: xx.xx.xx.xx Jul 22 18:56:38 OpenMPTCProuter daemon.info [9087]: <info> [modem0/bearer1] MTU: 1500 Jul 22 18:56:38 OpenMPTCProuter daemon.info [9087]: <info> [modem0/bearer1] reloading stats is supported by the device Jul 22 18:56:38 OpenMPTCProuter daemon.info [9087]: <info> [modem0] state changed (connecting -> connected) Jul 22 18:56:38 OpenMPTCProuter daemon.info [9087]: <info> [modem0] simple connect state (10/10): all done Jul 22 18:56:38 OpenMPTCProuter daemon.notice netifd: wan1 (17048): successfully connected the modem Jul 22 18:56:38 OpenMPTCProuter daemon.notice netifd: wan1 (17048): signal refresh rate is not set Jul 22 18:56:38 OpenMPTCProuter daemon.notice netifd: wan1 (17048): network operator name: Pelephone Jul 22 18:56:38 OpenMPTCProuter daemon.notice netifd: wan1 (17048): network operator MCCMNC: 42503 Jul 22 18:56:38 OpenMPTCProuter daemon.notice netifd: wan1 (17048): registration type: home Jul 22 18:56:38 OpenMPTCProuter daemon.notice netifd: wan1 (17048): access technology: lte Jul 22 18:56:38 OpenMPTCProuter daemon.notice netifd: wan1 (17048): signal quality: 63% Jul 22 18:56:38 OpenMPTCProuter daemon.notice netifd: wan1 (17048): IPv4 connection setup required in interface wan1: static Jul 22 18:56:38 OpenMPTCProuter daemon.notice netifd: wan1 (17048): adding IPv4 address xx.xx.xx.xx, netmask 255.255.255.248 Jul 22 18:56:38 OpenMPTCProuter daemon.notice netifd: wan1 (17048): adding default IPv4 route via xx.xx.xx.xx Jul 22 18:56:38 OpenMPTCProuter daemon.notice netifd: wan1 (17048): adding primary DNS at xx.xx.xx.xx Jul 22 18:56:38 OpenMPTCProuter daemon.notice netifd: wan1 (17048): adding secondary DNS at xx.xx.xx.xx Jul 22 18:56:38 OpenMPTCProuter daemon.notice netifd: Interface 'wan1' is now up Jul 22 18:56:38 OpenMPTCProuter daemon.notice netifd: Network device 'wwan0' link is up Jul 22 18:56:38 OpenMPTCProuter daemon.warn [9087]: <warn> [SQM_IFB_cd0da] invalid sysfs path read for net/SQM_IFB_cd0da Jul 22 18:56:38 OpenMPTCProuter daemon.warn [9087]: <warn> [base-manager] couldn't handle kernel event: device net/SQM_IFB_cd0da not found Jul 22 18:56:39 OpenMPTCProuter daemon.warn [9087]: <warn> [SQM_IFB_989c5] invalid sysfs path read for net/SQM_IFB_989c5 Jul 22 18:56:39 OpenMPTCProuter daemon.warn [9087]: <warn> [base-manager] couldn't handle kernel event: device net/SQM_IFB_989c5 not found Jul 22 18:56:39 OpenMPTCProuter user.notice firewall: Reloading firewall due to ifup of wan3 (eth2) Jul 22 18:56:40 OpenMPTCProuter user.notice firewall.omr-server: Firewall reload, set server part firewall reloading Jul 22 18:56:41 OpenMPTCProuter user.notice omr-tracker: Launched Jul 22 18:56:42 OpenMPTCProuter user.notice SQM-autorate: Set config for wan1 Jul 22 18:56:42 OpenMPTCProuter user.notice SQM-autorate: Set config for wan2 Jul 22 18:56:42 OpenMPTCProuter user.notice SQM-autorate: Set config for omrvpn Jul 22 18:56:42 OpenMPTCProuter user.notice post-tracking-post-tracking: omrvpn down because omrvpn may have ip issues, interface have no IPv4 Jul 22 18:56:42 OpenMPTCProuter user.notice SQM-autorate: Set config for lan Jul 22 18:56:42 OpenMPTCProuter user.notice SQM-autorate: Set config for wan3 Jul 22 18:56:42 OpenMPTCProuter user.notice SQM-autorate: Launch... Jul 22 18:56:42 OpenMPTCProuter daemon.info unbound: [11115:0] info: generate keytag query _ta-4f66. NULL IN Jul 22 18:56:43 OpenMPTCProuter user.notice mptcp: Reloading mptcp config due to ifup of wan3 (eth2) Jul 22 18:56:43 OpenMPTCProuter user.notice post-tracking-post-tracking: Glorytun VPN down, restart it Jul 22 18:56:43 OpenMPTCProuter daemon.info /usr/bin/ss-local[20744]: using tcp fast open Jul 22 18:56:43 OpenMPTCProuter user.info : using tcp fast open Jul 22 18:56:43 OpenMPTCProuter daemon.info /usr/bin/ss-redir[20746]: enable TCP no-delay Jul 22 18:56:43 OpenMPTCProuter daemon.info /usr/bin/ss-redir[20746]: initializing ciphers... chacha20-ietf-poly1305 Jul 22 18:56:43 OpenMPTCProuter daemon.info /usr/bin/ss-redir[20746]: listening at 0.0.0.0:1101 Jul 22 18:56:43 OpenMPTCProuter daemon.info /usr/bin/ss-redir[20746]: tcp port reuse enabled Jul 22 18:56:43 OpenMPTCProuter daemon.info /usr/bin/ss-redir[20746]: UDP relay enabled Jul 22 18:56:43 OpenMPTCProuter daemon.info /usr/bin/ss-redir[20746]: udp port reuse enabled Jul 22 18:56:43 OpenMPTCProuter daemon.info /usr/bin/ss-redir[20746]: running from root user Jul 22 18:56:43 OpenMPTCProuter user.info : using tcp fast open Jul 22 18:56:43 OpenMPTCProuter daemon.info /usr/bin/ss-redir[20745]: enable TCP no-delay Jul 22 18:56:43 OpenMPTCProuter daemon.info /usr/bin/ss-redir[20745]: resolving hostname to IPv6 address first Jul 22 18:56:43 OpenMPTCProuter daemon.info /usr/bin/ss-local[20744]: enable TCP no-delay Jul 22 18:56:43 OpenMPTCProuter daemon.info /usr/bin/ss-local[20744]: initializing ciphers... chacha20-ietf-poly1305 Jul 22 18:56:43 OpenMPTCProuter daemon.info /usr/bin/ss-local[20744]: listening at 127.0.0.1:1111 Jul 22 18:56:43 OpenMPTCProuter daemon.info /usr/bin/ss-redir[20745]: initializing ciphers... chacha20-ietf-poly1305 Jul 22 18:56:43 OpenMPTCProuter daemon.info /usr/bin/ss-redir[20745]: listening at :::1100 Jul 22 18:56:43 OpenMPTCProuter daemon.info /usr/bin/ss-redir[20745]: tcp port reuse enabled Jul 22 18:56:43 OpenMPTCProuter daemon.info /usr/bin/ss-local[20744]: tcp port reuse enabled Jul 22 18:56:43 OpenMPTCProuter daemon.info /usr/bin/ss-redir[20745]: UDP relay enabled Jul 22 18:56:43 OpenMPTCProuter daemon.info /usr/bin/ss-local[20744]: udprelay enabled Jul 22 18:56:43 OpenMPTCProuter daemon.info /usr/bin/ss-redir[20745]: udp port reuse enabled Jul 22 18:56:43 OpenMPTCProuter daemon.info /usr/bin/ss-local[20744]: udp port reuse enabled Jul 22 18:56:43 OpenMPTCProuter daemon.info /usr/bin/ss-local[20744]: running from root user Jul 22 18:56:43 OpenMPTCProuter daemon.info /usr/bin/ss-redir[20745]: running from root user Jul 22 18:56:43 OpenMPTCProuter daemon.info glorytun[12198]: STOPPED tun0 Jul 22 18:56:43 OpenMPTCProuter daemon.notice netifd: Network device 'tun0' link is down Jul 22 18:56:43 OpenMPTCProuter daemon.notice netifd: Interface 'omrvpn' has link connectivity loss Jul 22 18:56:43 OpenMPTCProuter daemon.notice netifd: Interface 'omrvpn' is now down Jul 22 18:56:44 OpenMPTCProuter daemon.info glorytun: starting glorytun vpn instance vpn Jul 22 18:56:44 OpenMPTCProuter daemon.notice netifd: Interface 'omrvpn' is disabled Jul 22 18:56:44 OpenMPTCProuter daemon.info glorytun[21002]: INITIALIZED tun0 Jul 22 18:56:44 OpenMPTCProuter daemon.notice netifd: Interface 'omrvpn' is enabled Jul 22 18:56:44 OpenMPTCProuter daemon.notice netifd: Interface 'omrvpn' is disabled Jul 22 18:56:44 OpenMPTCProuter daemon.notice netifd: Interface 'omrvpn' is enabled Jul 22 18:56:44 OpenMPTCProuter daemon.notice netifd: Network device 'tun0' link is up Jul 22 18:56:44 OpenMPTCProuter daemon.notice netifd: Interface 'omrvpn' has link connectivity Jul 22 18:56:44 OpenMPTCProuter daemon.notice netifd: Interface 'omrvpn' is setting up now Jul 22 18:56:44 OpenMPTCProuter daemon.notice netifd: Interface 'omrvpn' is now up Jul 22 18:56:44 OpenMPTCProuter daemon.err usbmuxd[21263]: [18:56:44.814][3] usbmuxd v1.1.1 starting up Jul 22 18:56:44 OpenMPTCProuter daemon.err usbmuxd[21263]: [18:56:44.814][3] Using libusb 1.0.26 Jul 22 18:56:44 OpenMPTCProuter daemon.err usbmuxd[21263]: [18:56:44.816][3] Initialization complete Jul 22 18:56:44 OpenMPTCProuter daemon.err usbmuxd[21263]: [18:56:44.816][3] Enabled exit on SIGUSR1 if no devices are attached. Start a new instance with "--exit" to trigger. Jul 22 18:56:45 OpenMPTCProuter daemon.err glorytun[21002]: xx.xx.xx.xx.65001: connected Jul 22 18:56:45 OpenMPTCProuter daemon.err glorytun[21002]: couldn't set socket optionTCP_NODELAY' Jul 22 18:56:45 OpenMPTCProuter daemon.err glorytun[21002]: couldn't set socket option TCP_KEEPCNT' Jul 22 18:56:45 OpenMPTCProuter daemon.err glorytun[21002]: couldn't set socket optionTCP_KEEPIDLE' Jul 22 18:56:45 OpenMPTCProuter daemon.err glorytun[21002]: couldn't set socket option TCP_KEEPINTVL' Jul 22 18:56:45 OpenMPTCProuter daemon.err glorytun[21002]: couldn't set socket optionTCP_USER_TIMEOUT' Jul 22 18:56:45 OpenMPTCProuter daemon.info glorytun[21002]: STARTED tun0 Jul 22 18:56:46 OpenMPTCProuter user.notice post-tracking-post-tracking: Can't find omr-bypass rules, restart omr-bypass... Jul 22 18:56:48 OpenMPTCProuter daemon.warn [9087]: [SQM_IFB_8ae82] invalid sysfs path read for net/SQM_IFB_8ae82 Jul 22 18:56:48 OpenMPTCProuter daemon.warn [9087]: [base-manager] couldn't handle kernel event: device net/SQM_IFB_8ae82 not found Jul 22 18:56:48 OpenMPTCProuter daemon.warn [9087]: [SQM_IFB_03d15] invalid sysfs path read for net/SQM_IFB_03d15 Jul 22 18:56:48 OpenMPTCProuter daemon.warn [9087]: [base-manager] couldn't handle kernel event: device net/SQM_IFB_03d15 not found Jul 22 18:56:49 OpenMPTCProuter user.notice firewall: Reloading firewall due to ifup of omrvpn (tun0) Jul 22 18:56:49 OpenMPTCProuter daemon.warn [9087]: [SQM_IFB_74daa] invalid sysfs path read for net/SQM_IFB_74daa Jul 22 18:56:49 OpenMPTCProuter daemon.warn [9087]: [base-manager] couldn't handle kernel event: device net/SQM_IFB_74daa not found Jul 22 18:56:50 OpenMPTCProuter user.notice firewall.omr-server: Firewall reload, set server part firewall reloading Jul 22 18:56:51 OpenMPTCProuter user.notice mptcp: Reloading mptcp config due to ifup of omrvpn (tun0) Jul 22 18:56:53 OpenMPTCProuter user.notice omr-bypass: Starting OMR-ByPass... Jul 22 18:56:57 OpenMPTCProuter user.notice post-tracking-post-tracking: Set firewall on server vps Jul 22 18:56:57 OpenMPTCProuter daemon.warn [9087]: [SQM_IFB_1a236] invalid sysfs path read for net/SQM_IFB_1a236 Jul 22 18:56:57 OpenMPTCProuter daemon.warn [9087]: [base-manager] couldn't handle kernel event: device net/SQM_IFB_1a236 not found Jul 22 18:56:58 OpenMPTCProuter daemon.warn [9087]: [SQM_IFB_74b28] invalid sysfs path read for net/SQM_IFB_74b28 Jul 22 18:56:58 OpenMPTCProuter daemon.warn [9087]: [base-manager] couldn't handle kernel event: device net/SQM_IFB_74b28 not found Jul 22 18:56:59 OpenMPTCProuter daemon.warn [9087]: [SQM_IFB_b3090] invalid sysfs path read for net/SQM_IFB_b3090 Jul 22 18:56:59 OpenMPTCProuter daemon.warn [9087]: [base-manager] couldn't handle kernel event: device net/SQM_IFB_b3090 not found Jul 22 18:57:00 OpenMPTCProuter user.notice firewall: Reloading firewall due to ifup of wan1 (wwan0) Jul 22 18:57:01 OpenMPTCProuter user.notice firewall.omr-server: Firewall reload, set server part firewall reloading Jul 22 18:57:01 OpenMPTCProuter user.notice omr-bypass: OMR-ByPass is running Jul 22 18:57:02 OpenMPTCProuter user.notice mptcp: Reloading mptcp config due to ifup of wan1 (wwan0) Jul 22 18:57:03 OpenMPTCProuter user.notice omr-bypass: Starting OMR-ByPass... Jul 22 18:57:05 OpenMPTCProuter user.notice cake-autorate.omrvpn: INFO: 1690052225.697038 Starting cake-autorate with PID: 20053 and config: /root/cake-autorate/config.omrvpn.sh Jul 22 18:57:06 OpenMPTCProuter daemon.info unbound: [11115:0] info: service stopped (unbound 1.17.1). Jul 22 18:57:06 OpenMPTCProuter daemon.info unbound: [11115:0] info: server stats for thread 0: 9 queries, 0 answers from cache, 9 recursions, 0 prefetch, 0 rejected by ip ratelimiting Jul 22 18:57:06 OpenMPTCProuter daemon.info unbound: [11115:0] info: server stats for thread 0: requestlist max 8 avg 2.66667 exceeded 0 jostled 0 Jul 22 18:57:06 OpenMPTCProuter daemon.info unbound: [11115:0] info: average recursion processing time 0.303417 sec Jul 22 18:57:06 OpenMPTCProuter daemon.info unbound: [11115:0] info: histogram of recursion processing times Jul 22 18:57:06 OpenMPTCProuter daemon.info unbound: [11115:0] info: [25%]=0.114688 median[50%]=0.229376 [75%]=0.49152 Jul 22 18:57:06 OpenMPTCProuter daemon.info unbound: [11115:0] info: lower(secs) upper(secs) recursions Jul 22 18:57:06 OpenMPTCProuter daemon.info unbound: [11115:0] info: 0.065536 0.131072 3 Jul 22 18:57:06 OpenMPTCProuter daemon.info unbound: [11115:0] info: 0.131072 0.262144 2 Jul 22 18:57:06 OpenMPTCProuter daemon.info unbound: [11115:0] info: 0.262144 0.524288 2 Jul 22 18:57:06 OpenMPTCProuter daemon.info unbound: [11115:0] info: 0.524288 1.000000 2 Jul 22 18:57:07 OpenMPTCProuter user.notice post-tracking-post-tracking: Tunnel up : Replace default route by 10.255.255.1 dev tun0 Jul 22 18:57:07 OpenMPTCProuter daemon.notice unbound: [1317:0] notice: init module 0: validator Jul 22 18:57:07 OpenMPTCProuter daemon.notice unbound: [1317:0] notice: init module 1: iterator Jul 22 18:57:08 OpenMPTCProuter daemon.info unbound: [1317:0] info: start of service (unbound 1.17.1). Jul 22 18:57:09 OpenMPTCProuter user.notice omr-bypass: OMR-ByPass is running Jul 22 18:57:10 OpenMPTCProuter user.notice firewall.omr-server: Firewall reload, set server part firewall reloading Jul 22 18:57:10 OpenMPTCProuter daemon.notice ttyd[2550]: [2023/07/22 18:57:10:9229] N: ttyd 1.7.3 (libwebsockets 4.3.2-unknown) Jul 22 18:57:10 OpenMPTCProuter daemon.notice ttyd[2550]: [2023/07/22 18:57:10:9231] N: tty configuration: Jul 22 18:57:10 OpenMPTCProuter daemon.notice ttyd[2550]: [2023/07/22 18:57:10:9245] N: start command: /bin/login Jul 22 18:57:10 OpenMPTCProuter daemon.notice ttyd[2550]: [2023/07/22 18:57:10:9247] N: close signal: SIGHUP (1) Jul 22 18:57:10 OpenMPTCProuter daemon.notice ttyd[2550]: [2023/07/22 18:57:10:9249] N: terminal type: xterm-256color Jul 22 18:57:10 OpenMPTCProuter daemon.notice ttyd[2550]: [2023/07/22 18:57:10:9685] N: /usr/lib/libwebsockets-evlib_uv.so Jul 22 18:57:10 OpenMPTCProuter daemon.notice ttyd[2550]: [2023/07/22 18:57:10:9689] N: lws_create_context: LWS: 4.3.2-unknown, NET CLI SRV H1 H2 WS ConMon IPV6-off Jul 22 18:57:10 OpenMPTCProuter daemon.notice ttyd[2550]: [2023/07/22 18:57:10:9697] N: elops_init_pt_uv: Using foreign event loop... Jul 22 18:57:10 OpenMPTCProuter daemon.notice ttyd[2550]: [2023/07/22 18:57:10:9704] N: lws_lc_tag: ++ [wsi|0|pipe] (1) Jul 22 18:57:10 OpenMPTCProuter daemon.notice ttyd[2550]: [2023/07/22 18:57:10:9708] N: lws_lc_tag: ++ [vh|0|netlink] (1) Jul 22 18:57:10 OpenMPTCProuter daemon.notice ttyd[2550]: [2023/07/22 18:57:10:9714] N: lws_lc_tag: ++ [vh|1|default|eth0|eth0|7681] (2) Jul 22 18:57:10 OpenMPTCProuter daemon.notice ttyd[2550]: [2023/07/22 18:57:10:9747] N: [vh|1|default|eth0|eth0|7681]: lws_socket_bind: source ads 192.168.100.1 Jul 22 18:57:10 OpenMPTCProuter daemon.notice ttyd[2550]: [2023/07/22 18:57:10:9749] N: lws_lc_tag: ++ [wsi|1|listen|default|eth0|7681] (2) Jul 22 18:57:10 OpenMPTCProuter daemon.notice ttyd[2550]: [2023/07/22 18:57:10:9751] N: Listening on port: 7681 Jul 22 18:57:11 OpenMPTCProuter daemon.notice procd: /etc/rc.d/S99v2ray: Flush terminated Jul 22 18:57:11 OpenMPTCProuter user.notice SQM-autorate: Set config for wan1 Jul 22 18:57:11 OpenMPTCProuter user.notice SQM-autorate: Set config for wan2 Jul 22 18:57:11 OpenMPTCProuter user.notice SQM-autorate: Set config for omrvpn Jul 22 18:57:11 OpenMPTCProuter user.notice SQM-autorate: Set config for lan Jul 22 18:57:11 OpenMPTCProuter user.notice SQM-autorate: Set config for wan3 Jul 22 18:57:11 OpenMPTCProuter user.notice SQM-autorate: Launch... Jul 22 18:57:11 OpenMPTCProuter daemon.info procd: - init complete - Jul 22 18:57:12 OpenMPTCProuter user.notice cake-autorate.omrvpn: INFO: 1690052232.697259 Stopped cake-autorate with PID: 20053 and config: /root/cake-autorate/config.omrvpn.sh Jul 22 18:57:13 OpenMPTCProuter user.notice post-tracking-post-tracking: Set firewall on server vps Jul 22 18:57:14 OpenMPTCProuter daemon.notice ttyd[2550]: [2023/07/22 18:57:14:7824] N: rops_handle_POLLIN_netlink: DELADDR Jul 22 18:57:16 OpenMPTCProuter daemon.notice ttyd[2550]: [2023/07/22 18:57:16:3311] N: rops_handle_POLLIN_netlink: DELADDR Jul 22 18:57:16 OpenMPTCProuter daemon.warn [9087]: [SQM_IFB_3d2d4] invalid sysfs path read for net/SQM_IFB_3d2d4 Jul 22 18:57:16 OpenMPTCProuter daemon.warn [9087]: [base-manager] couldn't handle kernel event: device net/SQM_IFB_3d2d4 not found Jul 22 18:57:17 OpenMPTCProuter daemon.warn [9087]: [SQM_IFB_1dabf] invalid sysfs path read for net/SQM_IFB_1dabf Jul 22 18:57:17 OpenMPTCProuter daemon.warn [9087]: [base-manager] couldn't handle kernel event: device net/SQM_IFB_1dabf not found Jul 22 18:57:18 OpenMPTCProuter daemon.warn [9087]: [SQM_IFB_eb54c] invalid sysfs path read for net/SQM_IFB_eb54c Jul 22 18:57:18 OpenMPTCProuter daemon.warn [9087]: [base-manager] couldn't handle kernel event: device net/SQM_IFB_eb54c not found Jul 22 18:57:18 OpenMPTCProuter daemon.warn [9087]: [SQM_IFB_1efda] invalid sysfs path read for net/SQM_IFB_1efda Jul 22 18:57:18 OpenMPTCProuter daemon.warn [9087]: [base-manager] couldn't handle kernel event: device net/SQM_IFB_1efda not found Jul 22 18:57:19 OpenMPTCProuter daemon.warn [9087]: [SQM_IFB_c604b] invalid sysfs path read for net/SQM_IFB_c604b Jul 22 18:57:19 OpenMPTCProuter daemon.warn [9087]: [base-manager] couldn't handle kernel event: device net/SQM_IFB_c604b not found Jul 22 18:57:20 OpenMPTCProuter daemon.warn [9087]: [SQM_IFB_4adc2] invalid sysfs path read for net/SQM_IFB_4adc2 Jul 22 18:57:20 OpenMPTCProuter daemon.warn [9087]: [base-manager] couldn't handle kernel event: device net/SQM_IFB_4adc2 not found Jul 22 18:57:20 OpenMPTCProuter daemon.warn [9087]: [SQM_IFB_c545e] invalid sysfs path read for net/SQM_IFB_c545e Jul 22 18:57:20 OpenMPTCProuter daemon.warn [9087]: [base-manager] couldn't handle kernel event: device net/SQM_IFB_c545e not found Jul 22 18:57:21 OpenMPTCProuter daemon.warn [9087]: [SQM_IFB_b4e77] invalid sysfs path read for net/SQM_IFB_b4e77 Jul 22 18:57:21 OpenMPTCProuter daemon.warn [9087]: [base-manager] couldn't handle kernel event: device net/SQM_IFB_b4e77 not found Jul 22 18:57:21 OpenMPTCProuter daemon.warn [9087]: [SQM_IFB_6783b] invalid sysfs path read for net/SQM_IFB_6783b Jul 22 18:57:21 OpenMPTCProuter daemon.warn [9087]: [base-manager] couldn't handle kernel event: device net/SQM_IFB_6783b not found Jul 22 18:57:22 OpenMPTCProuter daemon.warn [9087]: [SQM_IFB_fd7b1] invalid sysfs path read for net/SQM_IFB_fd7b1 Jul 22 18:57:22 OpenMPTCProuter daemon.warn [9087]: [base-manager] couldn't handle kernel event: device net/SQM_IFB_fd7b1 not found Jul 22 18:57:29 OpenMPTCProuter user.notice cake-autorate.omrvpn: INFO: 1690052249.455627 Starting cake-autorate with PID: 3563 and config: /root/cake-autorate/config.omrvpn.sh Jul 22 18:58:59 OpenMPTCProuter authpriv.info dropbear[18412]: Child connection from 192.168.100.3:50980 Jul 22 18:58:59 OpenMPTCProuter authpriv.notice dropbear[18412]: Auth succeeded with blank password for 'root' from 192.168.100.3:50980 Jul 22 19:00:29 OpenMPTCProuter authpriv.info dropbear[18412]: Exit (root) from <192.168.100.3:50980>: Disconnect received Jul 22 19:03:04 OpenMPTCProuter authpriv.info dropbear[7561]: Child connection from 192.168.100.3:42012 Jul 22 19:03:04 OpenMPTCProuter authpriv.notice dropbear[7561]: Auth succeeded with blank password for 'root' from 192.168.100.3:42012 Jul 22 19:03:32 OpenMPTCProuter user.notice cake-autorate.omrvpn: INFO: 1690052612.473378 Warning: Configured global ping response timeout: 300 seconds exceeded. Jul 22 19:07:14 OpenMPTCProuter user.notice cake-autorate.omrvpn: ERROR: 1690052834.716924 Received request to change maintain_pingers state to existing state. Jul 22 19:12:14 OpenMPTCProuter user.notice cake-autorate.omrvpn: INFO: 1690053134.381521 Warning: Configured global ping response timeout: 300 seconds exceeded. Jul 22 19:13:33 OpenMPTCProuter user.notice cake-autorate.omrvpn: ERROR: 1690053213.466097 Received request to change maintain_pingers state to existing state. Jul 22 19:15:15 OpenMPTCProuter authpriv.info dropbear[8497]: Child connection from 192.168.100.3:56212 Jul 22 19:15:15 OpenMPTCProuter authpriv.notice dropbear[8497]: Auth succeeded with blank password for 'root' from 192.168.100.3:56212 Jul 22 19:18:32 OpenMPTCProuter user.notice cake-autorate.omrvpn: INFO: 1690053512.432696 Warning: Configured global ping response timeout: 300 seconds exceeded. Jul 22 19:18:45 OpenMPTCProuter daemon.info unbound: [1317:0] info: generate keytag query _ta-4f66. NULL IN Jul 22 19:18:46 OpenMPTCProuter user.notice cake-autorate.omrvpn: ERROR: 1690053526.087384 Received request to change maintain_pingers state to existing state. Jul 22 19:19:14 OpenMPTCProuter authpriv.info dropbear[29707]: Child connection from 192.168.100.3:42010 Jul 22 19:19:15 OpenMPTCProuter authpriv.notice dropbear[29707]: Auth succeeded with blank password for 'root' from 192.168.100.3:42010 Jul 22 19:19:17 OpenMPTCProuter daemon.info [9087]: [modem0] 3GPP registration state changed (home -> unknown) Jul 22 19:19:17 OpenMPTCProuter daemon.info [9087]: [modem0] 3GPP registration state changed (unknown -> registering) Jul 22 19:19:17 OpenMPTCProuter daemon.info [9087]: [modem0] 3GPP registration state changed (registering -> home) Jul 22 19:19:18 OpenMPTCProuter daemon.info [9087]: [modem0] 3GPP registration state changed (home -> registering) Jul 22 19:19:18 OpenMPTCProuter daemon.info [9087]: [modem0] 3GPP registration state changed (registering -> home) Jul 22 19:19:18 OpenMPTCProuter daemon.info [9087]: [modem0] 3GPP registration state changed (home -> registering) Jul 22 19:19:18 OpenMPTCProuter daemon.info [9087]: [modem0] 3GPP registration state changed (registering -> home) Jul 22 19:19:20 OpenMPTCProuter daemon.info [9087]: [modem0] 3GPP registration state changed (home -> unknown) Jul 22 19:19:20 OpenMPTCProuter daemon.info [9087]: [modem0] 3GPP registration state changed (unknown -> registering) Jul 22 19:19:20 OpenMPTCProuter daemon.info [9087]: [modem0] 3GPP registration state changed (registering -> home) Jul 22 19:19:20 OpenMPTCProuter daemon.info [9087]: [modem0] 3GPP registration state changed (home -> registering) Jul 22 19:19:20 OpenMPTCProuter daemon.info [9087]: [modem0] 3GPP registration state changed (registering -> home) Jul 22 19:19:20 OpenMPTCProuter daemon.info [9087]: [modem0] 3GPP registration state changed (home -> registering) Jul 22 19:19:20 OpenMPTCProuter daemon.info [9087]: [modem0] 3GPP registration state changed (registering -> home) Jul 22 19:19:29 OpenMPTCProuter authpriv.info dropbear[31098]: Child connection from 192.168.100.3:45916 Jul 22 19:19:29 OpenMPTCProuter authpriv.notice dropbear[31098]: Auth succeeded with blank password for 'root' from 192.168.100.3:45916 Jul 22 19:23:59 OpenMPTCProuter user.notice cake-autorate.omrvpn: INFO: 1690053839.548056 Warning: Configured global ping response timeout: 300 seconds exceeded. Jul 22 19:36:50 OpenMPTCProuter user.notice cake-autorate.omrvpn: ERROR: 1690054610.306882 Received request to change maintain_pingers state to existing state. Jul 22 19:36:53 OpenMPTCProuter user.notice post-tracking-post-tracking: Check API configuration... Jul 22 19:36:53 OpenMPTCProuter user.notice post-tracking-post-tracking: Check API configuration... Done Jul 22 19:44:58 OpenMPTCProuter user.notice cake-autorate.omrvpn: INFO: 1690055098.026352 Warning: Configured global ping response timeout: 300 seconds exceeded. Jul 22 19:54:43 OpenMPTCProuter user.notice cake-autorate.omrvpn: ERROR: 1690055683.497641 Received request to change maintain_pingers state to existing state.

[Ysurac]

You can go back to 5.4 kernel and test yes, I never had any good result with 5.15 (I will stop compiling for it). Maybe possible to port 5.15 patches to compile on 6.1 ?

[JohnTar22]

Hi, thanks for the reply, went back to 5.4, now it looks good, i'll keep testing it in the next few days to see if it's stable. I don't have a good answer about compiling kernel 6.1 for this specific device family, i guess i'll do it if i have to. Please keep this issue open for the next few days so i can make further testing. Thanks again for the help and this great project!

[JohnTar22]

did a few tests, trying to stream live HD video over OMR, when using cubic after 2 minutes (give or take) it just halts and kills the connection, when i changed to bbr and changed the tcp syn to 8 (kernel 5.4) it holds fine, doesn't really use the entire bandwidth but at least it;s stable. another thing is that even when i join 4 lte modems (2 cat 4 and 2 cat 20) i still get a laggy stream on the host. when i run speedtest-cli --secure from a pc that's connected to the OMR i get 90mb download and 45mb upload. what am i missing? thanks!

[Ysurac]

Did you use SQM with download/upload speed set on each interface ?

[JohnTar22]

Iv'e checked the box but didn't set any values in the text boxes, how do i calculate the limits? On lte sometimes there's good reception and sometimes it falls back to 3g.

[JohnTar22]

I saw something about using "tc" command, any "best practice" about the limit rates?

[Ysurac]

This is done via the wizard or via Network->SQM. You only need to put values that work in your case, put values and lower them if it's not working correctly. SQM-Autorate should do that automatically but this need more tests as it's not always working correctly.

[github-actions[bot]]

This issue is stale because it has been open 90 days with no activity. Remove stale label or comment or this will be closed in 5 days