search

Ysurac / openmptcprouter

OpenMPTCProuter is an open source solution to aggregate multiple internet connections using Multipath TCP (MPTCP) on OpenWrt
https://www.openmptcprouter.com/
GNU General Public License v3.0
1.92k stars 274 forks source link

OpenMPTCProuter v0.55 release candidate #959

Closed Ysurac closed 3 years ago

Ysurac commented 4 years ago

This issue is dedicated to OpenMPTCProuter v0.55.

For now nothing is tagged, it's only available as snapshot and not yet fully tested.

New features:

Nothing is tested yet.

Previous Beta **Beta1** Images: https://www.openmptcprouter.com/release/develop/5.4/ Latest VPS script required: ```wget -O - http://www.openmptcprouter.com/server-test/debian10-x86_64.sh | sh``` Known issues: * Multi VPS doesn't work * Rights error in Network->Firewall (solved in latest OpenWrt luci update) * Multi users doesn't work * OMR-ByPass doesn't work **Beta2** Images: https://www.openmptcprouter.com/release/develop/5.4/ Latest VPS script required: ```wget -O - http://www.openmptcprouter.com/server-test/debian10-x86_64.sh | sh``` Known issues: * Argon theme doesn't work well with multi users * OMR-ByPass problem with destination port bypass * Nginx-HA interface not working **Beta3** (2020/05/06) Images: https://www.openmptcprouter.com/release/develop/5.4/ Latest VPS script required: ```wget -O - http://www.openmptcprouter.com/server-test/debian10-x86_64.sh | sh``` Known issues: * Argon theme doesn't work well with multi users **Beta4** (2020/05/15) Images: https://www.openmptcprouter.com/release/develop/5.4/ Latest VPS script required: ```wget -O - http://www.openmptcprouter.com/server-test/debian10-x86_64.sh | sh``` Known issues: * Argon theme doesn't work well with multi users * BPI-R2 is slow (I'm testing patches to fix that) * WRT3200ACM/WRT32X doesn't compile (fixed) **Beta5** (2020/05/21) Images: https://www.openmptcprouter.com/release/develop/5.4/ Latest VPS script required: ```wget -O - http://www.openmptcprouter.com/server-test/debian10-x86_64.sh | sh``` Known issues: * Argon theme doesn't work well with multi users (this will not be fixed for now) * BPI-R2 is slow (I need to make more tests) * No network on RPI3 image (fixed for next beta) * IPv6 issue (will be fixed in next beta) * DSCP issue (fixed for next beta) **Beta6** (2020/05/27) Images: https://www.openmptcprouter.com/release/develop/5.4/ Latest VPS script required: ```wget -O - http://www.openmptcprouter.com/server-test/debian10-x86_64.sh | sh``` Known issues: * Argon theme doesn't work well with multi users (this will not be fixed for now) * BPI-R2 is slow (I need to make more tests) * Only one IPv6 ULA/Prefix can be used * Issue with VPNs (speed for glorytun TCP, other doesn't run) (Fixed for next release) **Beta7** (2020/05/31) Images: https://www.openmptcprouter.com/release/develop/5.4/ Latest VPS script required: ```wget -O - http://www.openmptcprouter.com/server-test/debian10-x86_64.sh | sh``` Known issues: * Argon theme doesn't work well with multi users (this will not be fixed for now) * BPI-R2 is slow (not yet tested with this kernel) * Issue if only one interface is available in balancing mode (fixed for next release) **Beta8** (2020/06/10) Images: https://www.openmptcprouter.com/release/develop/5.4/ Latest VPS script required: ```wget -O - http://www.openmptcprouter.com/server-test/debian10-x86_64.sh | sh``` Known issues: * Argon theme doesn't work well with multi users (this will not be fixed for now) * BPI-R2 need testing (some patches are applied in 5.4.45 kernel that is now used) * After wizard config keys are often downloaded, this need some times or to apply wizard again * flooding log with route error A new beta is compiling (2020/06/10), beta9 will fix routes and keys issues. **Beta9** (2020/06/10) Images: https://www.openmptcprouter.com/release/develop/5.4/ Latest VPS script required: ```wget -O - http://www.openmptcprouter.com/server-test/debian10-x86_64.sh | sh``` Known issues: * Argon theme doesn't work well with multi users (this will not be fixed for now) * BPI-R2 need testing (some patches are applied in 5.4.45 kernel that is now used) * Nothing work, OMR packages not compiled Beta10 is compiling (2020/06/10), I forgot to update OpenWrt in previous beta... (and nothing work in previous beta) **Beta10** (2020/06/11) Images: https://www.openmptcprouter.com/release/develop/5.4/ Latest VPS script required: ```wget -O - http://www.openmptcprouter.com/server-test/debian10-x86_64.sh | sh``` Known issues: * Argon theme doesn't work well with multi users (this will not be fixed for now) * BPI-R2 need testing (some patches are applied in 5.4.45 kernel that is now used) * Issue in multipath setting in Network->Interfaces * Opening port when VPN is not glorytun TCP doesn't work **Beta11** (2020/06/12) Images: https://www.openmptcprouter.com/release/develop/5.4/ Latest VPS script required: ```wget -O - http://www.openmptcprouter.com/server-test/debian10-x86_64.sh | sh``` Known issues: * Argon theme doesn't work well with multi users (this will not be fixed for now) * BPI-R2 need testing (some patches are applied in 5.4.45 kernel that is now used) * False report of "Multipath seems to be blocked on the connection" on many connections **Beta12** (2020/06/27) Images: https://www.openmptcprouter.com/release/develop/5.4/ Latest VPS script required: ```wget -O - http://www.openmptcprouter.com/server-test/debian10-x86_64.sh | sh``` Known issues: * Argon theme doesn't work well with multi users (this will not be fixed for now) * BPI-R2 need testing * MPTCP over VPN not working (fixed for next beta) * Check for Shadowsocks rules not working (fixed for next beta) * OMR-ByPass not working (working on this...) CircleCI is compiling Beta 13 **Beta13** (2020/06/29) Images: https://www.openmptcprouter.com/release/develop/5.4/ Latest VPS script required: ```wget -O - http://www.openmptcprouter.com/server-test/debian10-x86_64.sh | sh``` Known issues: * Argon theme doesn't work well with multi users (this will not be fixed for now) * BPI-R2 need testing * Chinese not available * OMR-Bypass doesn't work if not default public IP is used * log is full of a dirty IPv6 error **Beta14** (2020/06/30) Images: https://www.openmptcprouter.com/release/develop/5.4/ Latest VPS script required: ```wget -O - http://www.openmptcprouter.com/server-test/debian10-x86_64.sh | sh``` Known issues: * Argon theme doesn't work well with multi users (this will not be fixed for now) * BPI-R2 need testing * DSVPN doesn't work in load balancing * Previous routes not deleted when changing mode **Beta15** (2020/07/04) Images: https://www.openmptcprouter.com/release/develop/5.4/ Latest VPS script required: ```wget -O - http://www.openmptcprouter.com/server-test/debian10-x86_64.sh | sh``` Known issues: * Argon theme doesn't work well with multi users (this will not be fixed for now) * BPI-R2 need testing * vnstat display error (fixed for next beta) * omr-bypass protocol display error (fixed for next beta) * modem-manager/qmi device problem (fixed for next beta) * shadowsocks-libev interfaces rules add/edit (fixed for next beta) * pi-hole, other DNS removed (fixed for next beta) **Beta16** (2020/07/12) Images: https://download.openmptcprouter.com/release/v0.55beta16/ (moved to a new server) Latest VPS script required: ```wget -O - http://www.openmptcprouter.com/server-test/debian10-x86_64.sh | sh``` Known issues: * Argon theme doesn't work well with multi users (this will not be fixed for now) * BPI-R2 need testing * Not working on WRT32X/WRT3200ACM (fixed for next beta) **Beta17** (2020/07/16) Images: https://download.openmptcprouter.com/release/v0.55beta17/ Latest VPS script required: ```wget -O - http://www.openmptcprouter.com/server-test/debian10-x86_64.sh | sh``` Known issues: * Argon theme doesn't work well with multi users (this will not be fixed for now) * BPI-R2 need testing * MLVPN is not working * Problems with multi IP on VPS **Beta18** (2020/07/23) Images: https://download.openmptcprouter.com/release/v0.55beta18/ Latest VPS script required: ```wget -O - http://www.openmptcprouter.com/server-test/debian10-x86_64.sh | sh``` Known issues: * Argon theme doesn't work well with multi users (this will not be fixed for now) * BPI-R2 need testing **Beta19** (2020/07/30) Images: https://download.openmptcprouter.com/release/v0.55beta19/ Latest VPS script required: ```wget -O - http://www.openmptcprouter.com/server-test/debian10-x86_64.sh | sh``` Known issues: * Argon theme doesn't work well with multi users (this will not be fixed) **Release Candidate 1** (2020/08/04) Images: https://download.openmptcprouter.com/release/v0.55rc1/ Latest VPS script required: ```wget -O - http://www.openmptcprouter.com/server-test/debian10-x86_64.sh | sh``` Known issues: * Argon theme doesn't work well with multi users (this will not be fixed) * BPI-R2 image is not build * VPN traffic is tx+tx instead of tx+rx * RPI still give "Ring expansion failed" (workaround in next RC)

Release Candidate 2 (2020/08/07) Images: https://download.openmptcprouter.com/release/v0.55rc2/ Latest VPS script required: wget -O - http://www.openmptcprouter.com/server-test/debian10-x86_64.sh | sh

Known issues:

xabix commented 4 years ago

How is the new release looking? Would be happy to move to a newer kernel to see if we get better performances on virtualized environment. Beta 1 is there so not too long before we get something stable :)

brazzo97 commented 4 years ago

hi hyper-v is nomore supported ? thanks

Ysurac commented 4 years ago

Hyper-V and ova images are converted from .img images via a script only for release.

VoightKampff commented 4 years ago

Thank you for making the release process more public. I installed beta 2 and I can report it works as expected for a basic setup aggregating two WANs. What are the areas you would like testing/feedback on the most?

Ysurac commented 4 years ago

For now it's general testing, if it's working for a basic usage it's good. New features and some MPTCP patches will be added for next beta. What is the platform you use ? x86_64, RPI,... ? You tried an update or a new install ?

brazzo97 commented 4 years ago

can confirm that it works well on hyperv

VoightKampff commented 4 years ago

Info

I'm using a fresh image - openmptcprouter-v0.55beta2-r0+13089-3fdb08681b-x86-64-generic-ext4-combined.img on KVM/libvirt on an ancient hp 6005 with an AMD Athlon(tm) II X2 B24 Processor (it doesn't have aes, if that matters at all). I gave the VM 1 gig of ram.

The VPS is running a fresh install of debian 10 @ the Warsaw ovh DC. 1 vCore / 2 GB RAM / 40 GB NVMe / 250 Mbps, which is the lowest "normal" option they have in the range. (OVH changed their offer recently)

Bugs

Multiple 404 errors in the admin panel

The message is always in the following format

404 Not Found
Sorry, the object you requested was not found.

Unable to dispatch: /cgi-bin/luci/admin/system/openmptcprouter

If the interface has tab buttons, you can still get to a sub-page, just the default is broken. But if there are no tabs, the page is completely inaccessible. This occurs in these areas:

Debug UI polling feature (presumably) is left on

There is a label in the top right corner of the screen that says Refreshing or, if you click it Paused that seems to disable polling for ui updates.

Encryption setting in wizard is not always honored

Go to Wizard -> Advanced settings -> ShadowSocks settings. Disable ShadowSocks. Set encryption to None. Note the label which says Encryption method is also used for Glorytun. This setting does not seem to be applied to glorytun's config on the client side. In VPN settings below, if Default VPN is set to Glorytun UDP, the status screen will show Direct connection. Running glorytun-udp show returns cipher: chacha20poly1305. If I go to VPN -> Glorytun and manually disable the chacha20 checkbox, the tunnel starts working. If I change Default VPN to Glorytun TCP, the chacha20 checkbox in VPN -> Glorytun is still checked. I do not know how to check the status of the old tcp version of glorytun from the console or if that is even possible. I have not checked other VPN options.

Display issues on the status page for huawei modems

MPTCP over VPN does not work

When I select the MPTCP over VPN option on both of my WAN connections, the status page shows No ping to gateway in x seconds warnings for both wan connections (I didn't copy the exact text - going from memory). All traffic is going to the VPS through a single WAN connection bypassing the openvpn tunnels that were created, despise the status page indicating that the WANs are now the openvpn endpoints, not the real wan connections. After I restarted, the no ping... message was no longer shown, and the status page was all "green" and indicated that traffic would be going through the openvpn tunnels, but still all of the traffic was going to the VPS through a single WAN omitting the openvpn tunnels.

An additional issue is that after I unchecked the MPTCP over VPN checkboxes, MPTCP was set to disabled on all interfaces and I had to manually set it back to master and enabled in the Network->MPTCP screen.

I am certain this feature worked correctly when it was first introduced, because I remember testing it for a while when one of my ISPs was intermittently blocking MPTCP. (Thank you very much for implementing this for me :) ) I do not remember the specific version number, but it was probably the first version that had it.

Questions

Ysurac commented 4 years ago

404 errors are fixed in my local repo (a typo...) I will try to fix other bugs for next beta.

Redundant was renamed to balancing and it's related to the load balancing support. I think mwan3 do that in the same way, no idea. Multiples routes are created to the VPS when available and as default routes using all connections when no VPS available. So when the VPS is available, this should help for failover and without any VPS at least this provide a dirty load balancing.

salchris commented 4 years ago

rpi4 - updating SW lists

Bonding works... still testing. Thank you. (blockd and blockmount present! thank you)

screenshot
Ysurac commented 4 years ago

Package list should be fixed now.

salchris commented 4 years ago

not yet

`Collected errors:

VoightKampff commented 4 years ago

@Ysurac What kind of performance should I be getting with the updated version of glorytun (0.3.4)? I've peeked into the OTB repository, and I didn't see any reference to shadowsocks in the master branch there. They might be relying just on glorytun. However, I am getting pretty bad performance when I disable shadowsocks and set glorytun to UDP in 0.55beta2. glorytun reports that it's using 2 paths, so that's correct, and it seems I am getting aggregation. But the bandwidth gets distributed equally between both my LTE connections, and it is only around 50% of the slower one for both connections (I checked this from the modems status pages). So the total aggregated bandwidth is pretty much only what my slower LTE connection offers. Does glorytun only work well if the connections are "similar" in terms of bandwidth/latency/etc. ?

Ysurac commented 4 years ago

@salchris this time this should be fixed.

salchris commented 4 years ago

yes it is! thank you

Ysurac commented 4 years ago

@VoightKampff It's true, OTB seems to use only glorytun UDP in the repo. For now, I always get bad perf with glorytun UDP, I have no idea in which case (if any) glorytun UDP work well.

VoightKampff commented 4 years ago

@Ysurac It seems that omr-huawei was broken by this change https://github.com/Ysurac/openmptcprouter-feeds/commit/d76151eef58949a6d07b38e37152f48552bbaab2

root@OpenMPTCProuter:~# /bin/omr-huawei 192.168.8.1 all
;;connected;lte
root@OpenMPTCProuter:~# ./omr-huawei_beta2 192.168.8.1 all
100;O;;connected;lte

I didn't test anything else yet. Maybe tomorrow.

Ysurac commented 4 years ago

@VoightKampff I found the issue, this will be fixed in next release.

xabix commented 4 years ago

Having issues with the Beta 3 on the VPS, I get:

May 6 23:52:27 XabiX omr-service[928]: /etc/glorytun-udp/post.sh: 3: .: : not found May 6 23:52:27 XabiX omr-service[928]: /etc/glorytun-udp/post.sh: 3: .: : not found May 6 23:52:27 XabiX omr-service[928]: /etc/glorytun-udp/post.sh: 3: .: : not found May 6 23:52:27 XabiX omr-service[928]: /etc/glorytun-tcp/post.sh: 3: .: : not found May 6 23:52:27 XabiX omr-service[928]: /etc/glorytun-tcp/post.sh: 3: .: : not found May 6 23:52:27 XabiX omr-service[928]: /etc/glorytun-tcp/post.sh: 3: .: : not found

May 6 23:46:29 XabiX omr-admin.py[1467]: DEBUG: Get config... May 6 23:46:29 XabiX omr-admin.py[1467]: DEBUG: Get config... shadowsocks May 6 23:46:29 XabiX omr-admin.py[1467]: ERROR: Exception in ASGI application May 6 23:46:29 XabiX omr-admin.py[1467]: Traceback (most recent call last): May 6 23:46:29 XabiX omr-admin.py[1467]: File "/usr/local/lib/python3.7/dist-packages/uvicorn/protocols/http/httptools_impl.py", line 385, in run_asgi May 6 23:46:29 XabiX omr-admin.py[1467]: result = await app(self.scope, self.receive, self.send) May 6 23:46:29 XabiX omr-admin.py[1467]: File "/usr/local/lib/python3.7/dist-packages/uvicorn/middleware/proxy_headers.py", line 45, in call May 6 23:46:29 XabiX omr-admin.py[1467]: return await self.app(scope, receive, send) May 6 23:46:29 XabiX omr-admin.py[1467]: File "/usr/local/lib/python3.7/dist-packages/fastapi/applications.py", line 149, in call May 6 23:46:29 XabiX omr-admin.py[1467]: await super().call(scope, receive, send) May 6 23:46:29 XabiX omr-admin.py[1467]: File "/usr/local/lib/python3.7/dist-packages/starlette/applications.py", line 102, in call May 6 23:46:29 XabiX omr-admin.py[1467]: await self.middleware_stack(scope, receive, send) May 6 23:46:29 XabiX omr-admin.py[1467]: File "/usr/local/lib/python3.7/dist-packages/starlette/middleware/errors.py", line 181, in call May 6 23:46:29 XabiX omr-admin.py[1467]: raise exc from None May 6 23:46:29 XabiX omr-admin.py[1467]: File "/usr/local/lib/python3.7/dist-packages/starlette/middleware/errors.py", line 159, in call May 6 23:46:29 XabiX omr-admin.py[1467]: await self.app(scope, receive, _send) May 6 23:46:29 XabiX omr-admin.py[1467]: File "/usr/local/lib/python3.7/dist-packages/starlette/exceptions.py", line 82, in call May 6 23:46:29 XabiX omr-admin.py[1467]: raise exc from None May 6 23:46:29 XabiX omr-admin.py[1467]: File "/usr/local/lib/python3.7/dist-packages/starlette/exceptions.py", line 71, in call May 6 23:46:29 XabiX omr-admin.py[1467]: await self.app(scope, receive, sender) May 6 23:46:29 XabiX omr-admin.py[1467]: File "/usr/local/lib/python3.7/dist-packages/starlette/routing.py", line 550, in call May 6 23:46:29 XabiX omr-admin.py[1467]: await route.handle(scope, receive, send) May 6 23:46:29 XabiX omr-admin.py[1467]: File "/usr/local/lib/python3.7/dist-packages/starlette/routing.py", line 227, in handle May 6 23:46:29 XabiX omr-admin.py[1467]: await self.app(scope, receive, send) May 6 23:46:29 XabiX omr-admin.py[1467]: File "/usr/local/lib/python3.7/dist-packages/starlette/routing.py", line 41, in app May 6 23:46:29 XabiX omr-admin.py[1467]: response = await func(request) May 6 23:46:29 XabiX omr-admin.py[1467]: File "/usr/local/lib/python3.7/dist-packages/fastapi/routing.py", line 197, in app May 6 23:46:29 XabiX omr-admin.py[1467]: dependant=dependant, values=values, is_coroutine=is_coroutine May 6 23:46:29 XabiX omr-admin.py[1467]: File "/usr/local/lib/python3.7/dist-packages/fastapi/routing.py", line 148, in run_endpoint_function May 6 23:46:29 XabiX omr-admin.py[1467]: return await dependant.call(**values) May 6 23:46:29 XabiX omr-admin.py[1467]: File "/usr/local/bin/omr-admin.py", line 613, in config May 6 23:46:29 XabiX omr-admin.py[1467]: shadowsocks_key = data["port_key"][str(shadowsocks_port)] May 6 23:46:29 XabiX omr-admin.py[1467]: KeyError: 'port_key'

The Glory key was missing, if I add it back manually I get this (but if I come back the key is not saved):

May 6 23:52:32 XabiX omr-admin.py[1467]: shadowsocks_key = data["port_key"][str(shadowsocks_port)] May 6 23:52:32 XabiX omr-admin.py[1467]: KeyError: 'port_key' May 6 23:52:32 XabiX omr-admin.py[1467]: DEBUG: Get config... May 6 23:52:32 XabiX omr-admin.py[1467]: DEBUG: Get config... shadowsocks May 6 23:52:32 XabiX omr-admin.py[1467]: ERROR: Exception in ASGI application May 6 23:52:32 XabiX omr-admin.py[1467]: Traceback (most recent call last): May 6 23:52:32 XabiX omr-admin.py[1467]: File "/usr/local/lib/python3.7/dist-packages/uvicorn/protocols/http/httptools_impl.py", line 385, in run_asgi May 6 23:52:32 XabiX omr-admin.py[1467]: result = await app(self.scope, self.receive, self.send) May 6 23:52:32 XabiX omr-admin.py[1467]: File "/usr/local/lib/python3.7/dist-packages/uvicorn/middleware/proxy_headers.py", line 45, in call May 6 23:52:32 XabiX omr-admin.py[1467]: return await self.app(scope, receive, send) May 6 23:52:32 XabiX omr-admin.py[1467]: File "/usr/local/lib/python3.7/dist-packages/fastapi/applications.py", line 149, in call May 6 23:52:32 XabiX omr-admin.py[1467]: await super().call(scope, receive, send) May 6 23:52:32 XabiX omr-admin.py[1467]: File "/usr/local/lib/python3.7/dist-packages/starlette/applications.py", line 102, in call May 6 23:52:32 XabiX omr-admin.py[1467]: await self.middleware_stack(scope, receive, send) May 6 23:52:32 XabiX omr-admin.py[1467]: File "/usr/local/lib/python3.7/dist-packages/starlette/middleware/errors.py", line 181, in call May 6 23:52:32 XabiX omr-admin.py[1467]: raise exc from None May 6 23:52:32 XabiX omr-admin.py[1467]: File "/usr/local/lib/python3.7/dist-packages/starlette/middleware/errors.py", line 159, in call May 6 23:52:32 XabiX omr-admin.py[1467]: await self.app(scope, receive, _send) May 6 23:52:32 XabiX omr-admin.py[1467]: File "/usr/local/lib/python3.7/dist-packages/starlette/exceptions.py", line 82, in call May 6 23:52:32 XabiX omr-admin.py[1467]: raise exc from None May 6 23:52:32 XabiX omr-admin.py[1467]: File "/usr/local/lib/python3.7/dist-packages/starlette/exceptions.py", line 71, in call May 6 23:52:32 XabiX omr-admin.py[1467]: await self.app(scope, receive, sender) May 6 23:52:32 XabiX omr-admin.py[1467]: File "/usr/local/lib/python3.7/dist-packages/starlette/routing.py", line 550, in call May 6 23:52:32 XabiX omr-admin.py[1467]: await route.handle(scope, receive, send) May 6 23:52:32 XabiX omr-admin.py[1467]: File "/usr/local/lib/python3.7/dist-packages/starlette/routing.py", line 227, in handle May 6 23:52:32 XabiX omr-admin.py[1467]: await self.app(scope, receive, send) May 6 23:52:32 XabiX omr-admin.py[1467]: File "/usr/local/lib/python3.7/dist-packages/starlette/routing.py", line 41, in app May 6 23:52:32 XabiX omr-admin.py[1467]: response = await func(request) May 6 23:52:32 XabiX omr-admin.py[1467]: File "/usr/local/lib/python3.7/dist-packages/fastapi/routing.py", line 197, in app May 6 23:52:32 XabiX omr-admin.py[1467]: dependant=dependant, values=values, is_coroutine=is_coroutine May 6 23:52:32 XabiX omr-admin.py[1467]: File "/usr/local/lib/python3.7/dist-packages/fastapi/routing.py", line 148, in run_endpoint_function May 6 23:52:32 XabiX omr-admin.py[1467]: return await dependant.call(values) May 6 23:52:32 XabiX omr-admin.py[1467]: File "/usr/local/bin/omr-admin.py", line 613, in config May 6 23:52:32 XabiX omr-admin.py[1467]: shadowsocks_key = data["port_key"][str(shadowsocks_port)] May 6 23:52:32 XabiX omr-admin.py[1467]: KeyError: 'port_key' May 6 23:52:32 XabiX omr-admin.py[1467]: DEBUG: Get config... May 6 23:52:32 XabiX omr-admin.py[1467]: DEBUG: Get config... shadowsocks May 6 23:52:32 XabiX omr-admin.py[1467]: ERROR: Exception in ASGI application May 6 23:52:32 XabiX omr-admin.py[1467]: Traceback (most recent call last): May 6 23:52:32 XabiX omr-admin.py[1467]: File "/usr/local/lib/python3.7/dist-packages/uvicorn/protocols/http/httptools_impl.py", line 385, in run_asgi May 6 23:52:32 XabiX omr-admin.py[1467]: result = await app(self.scope, self.receive, self.send) May 6 23:52:32 XabiX omr-admin.py[1467]: File "/usr/local/lib/python3.7/dist-packages/uvicorn/middleware/proxy_headers.py", line 45, in call May 6 23:52:32 XabiX omr-admin.py[1467]: return await self.app(scope, receive, send) May 6 23:52:32 XabiX omr-admin.py[1467]: File "/usr/local/lib/python3.7/dist-packages/fastapi/applications.py", line 149, in call May 6 23:52:32 XabiX omr-admin.py[1467]: await super().call(scope, receive, send) May 6 23:52:32 XabiX omr-admin.py[1467]: File "/usr/local/lib/python3.7/dist-packages/starlette/applications.py", line 102, in call May 6 23:52:32 XabiX omr-admin.py[1467]: await self.middleware_stack(scope, receive, send) May 6 23:52:32 XabiX omr-admin.py[1467]: File "/usr/local/lib/python3.7/dist-packages/starlette/middleware/errors.py", line 181, in call May 6 23:52:32 XabiX omr-admin.py[1467]: raise exc from None May 6 23:52:32 XabiX omr-admin.py[1467]: File "/usr/local/lib/python3.7/dist-packages/starlette/middleware/errors.py", line 159, in call May 6 23:52:32 XabiX omr-admin.py[1467]: await self.app(scope, receive, _send) May 6 23:52:32 XabiX omr-admin.py[1467]: File "/usr/local/lib/python3.7/dist-packages/starlette/exceptions.py", line 82, in call May 6 23:52:32 XabiX omr-admin.py[1467]: raise exc from None May 6 23:52:32 XabiX omr-admin.py[1467]: File "/usr/local/lib/python3.7/dist-packages/starlette/exceptions.py", line 71, in call May 6 23:52:32 XabiX omr-admin.py[1467]: await self.app(scope, receive, sender) May 6 23:52:32 XabiX omr-admin.py[1467]: File "/usr/local/lib/python3.7/dist-packages/starlette/routing.py", line 550, in call May 6 23:52:32 XabiX omr-admin.py[1467]: await route.handle(scope, receive, send) May 6 23:52:32 XabiX omr-admin.py[1467]: File "/usr/local/lib/python3.7/dist-packages/starlette/routing.py", line 227, in handle May 6 23:52:32 XabiX omr-admin.py[1467]: await self.app(scope, receive, send) May 6 23:52:32 XabiX omr-admin.py[1467]: File "/usr/local/lib/python3.7/dist-packages/starlette/routing.py", line 41, in app May 6 23:52:32 XabiX omr-admin.py[1467]: response = await func(request) May 6 23:52:32 XabiX omr-admin.py[1467]: File "/usr/local/lib/python3.7/dist-packages/fastapi/routing.py", line 197, in app May 6 23:52:32 XabiX omr-admin.py[1467]: dependant=dependant, values=values, is_coroutine=is_coroutine May 6 23:52:32 XabiX omr-admin.py[1467]: File "/usr/local/lib/python3.7/dist-packages/fastapi/routing.py", line 148, in run_endpoint_function May 6 23:52:32 XabiX omr-admin.py[1467]: return await dependant.call(values) May 6 23:52:32 XabiX omr-admin.py[1467]: File "/usr/local/bin/omr-admin.py", line 613, in config May 6 23:52:32 XabiX omr-admin.py[1467]: shadowsocks_key = data["port_key"][str(shadowsocks_port)] May 6 23:52:32 XabiX omr-admin.py[1467]: KeyError: 'port_key'

I could save the key if I put chacha in ShadowSocks while it was AES. but still getting in loop

May 7 00:00:53 XabiX omr-service[928]: /etc/glorytun-tcp/post.sh: 3: .: : not found

Ysurac commented 4 years ago

What do you have in /etc/shadowsocks-libev/manager.json on the VPS ?

xabix commented 4 years ago

/etc/shadowsocks-libev/manager.json

root@XabiX:~# ls -l /etc/shadowsocks-libev/manager.json -rw-r--r-- 1 root root 531 May 6 22:30 /etc/shadowsocks-libev/manager.json

root@XabiX:~# more /etc/shadowsocks-libev/manager.json { "server": [ "[::0]", "0.0.0.0" ], "port_key": { "65101": "WpHPWs4LTD3ZL_xxx" "65101": "WpHPWs4LTD3ZL_xxx" }, "local_port": 1081, "mode": "tcp_and_udp", "timeout": 600, "method": "aes-256-gcm", "verbose": 0, "ipv6_first": true, "prefer_ipv6": false, "fast_open": true, "no_delay": true, "reuse_port": true, "mptcp": true, "ebpf": 0, "acl": "/etc/shadowsocks-libev/local.acl" }

Ysurac commented 4 years ago

I think this was an update. I fixed the script for that.

xabix commented 4 years ago

I think this was an update. I fixed the script for that.

How can I update to fix the issue then? image

Ysurac commented 4 years ago

By reinstalling the VPS part from scratch or adding a comma at the line beginning by 65101 in /etc/shadowsocks-libev/manager.json.

xabix commented 4 years ago

By reinstalling the VPS part from scratch or adding a comma at the line beginning by 65101 in /etc/shadowsocks-libev/manager.json.

image

Since I could save the Glory key, the only message I get now is: May 7 10:26:56 XabiX omr-service[928]: /etc/glorytun-tcp/post.sh: 3: .: : not found

How can I troubleshoot further?

I am OK to reconfigure it all but is there a way to reset the config on the VPS (who is running pihole as well) and the OMR to avoid to have to reinstall it all?

Ysurac commented 4 years ago

The comma must be added at the end of the line : "65101": "WpHPWs4LTD3ZL_xxx", For the post error, run the VPS script again.

xabix commented 4 years ago

The comma must be added at the end of the line : "65101": "WpHPWs4LTD3ZL_xxx", For the post error, run the VPS script again.

Did it keeping only one instance (and not two lines). But the script doesn't finish

Synchronizing state of haveged.service with SysV service script with /lib/systemd/systemd-sysv-install. Executing: /lib/systemd/systemd-sysv-install enable haveged E: Could not get lock /var/lib/dpkg/lock-frontend - open (11: Resource temporarily unavailable) E: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?

I rebooted and the script worked.

but still having issues:

May 7 14:37:13 XabiX systemd[1]: Started OMR. May 7 14:37:13 XabiX systemd[1]: Started Shadowsocks-Libev Custom Manager Service for manager. May 7 14:37:13 XabiX ss-manager[25321]: 2020-05-07 14:37:13 ERROR: 7:0: Expected : before " May 7 14:37:13 XabiX systemd[1]: shadowsocks-libev-manager@manager.service: Main process exited, code=exited, status=255/EXCEPTION May 7 14:37:13 XabiX systemd[1]: shadowsocks-libev-manager@manager.service: Failed with result 'exit-code'. May 7 14:37:13 XabiX omr-service[25314]: /etc/glorytun-udp/post.sh: 3: .: : not found May 7 14:37:13 XabiX omr-service[25314]: /etc/glorytun-tcp/post.sh: 3: .: : not found May 7 14:37:13 XabiX systemd[1]: shadowsocks-libev-manager@manager.service: Service RestartSec=100ms expired, scheduling restart. May 7 14:37:13 XabiX systemd[1]: shadowsocks-libev-manager@manager.service: Scheduled restart job, restart counter is at 1. May 7 14:37:13 XabiX systemd[1]: Stopped Shadowsocks-Libev Custom Manager Service for manager. May 7 14:37:13 XabiX systemd[1]: Started Shadowsocks-Libev Custom Manager Service for manager. May 7 14:37:13 XabiX ss-manager[25403]: 2020-05-07 14:37:13 ERROR: 7:0: Expected : before " May 7 14:37:13 XabiX systemd[1]: shadowsocks-libev-manager@manager.service: Main process exited, code=exited, status=255/EXCEPTION May 7 14:37:13 XabiX systemd[1]: shadowsocks-libev-manager@manager.service: Failed with result 'exit-code'. May 7 14:37:13 XabiX systemd[1]: shadowsocks-libev-manager@manager.service: Service RestartSec=100ms expired, scheduling restart. May 7 14:37:13 XabiX systemd[1]: shadowsocks-libev-manager@manager.service: Scheduled restart job, restart counter is at 2. May 7 14:37:13 XabiX systemd[1]: Stopped Shadowsocks-Libev Custom Manager Service for manager. May 7 14:37:13 XabiX systemd[1]: Started Shadowsocks-Libev Custom Manager Service for manager. May 7 14:37:13 XabiX ss-manager[25404]: 2020-05-07 14:37:13 ERROR: 7:0: Expected : before " May 7 14:37:13 XabiX systemd[1]: shadowsocks-libev-manager@manager.service: Main process exited, code=exited, status=255/EXCEPTION May 7 14:37:13 XabiX systemd[1]: shadowsocks-libev-manager@manager.service: Failed with result 'exit-code'. May 7 14:37:14 XabiX systemd[1]: shadowsocks-libev-manager@manager.service: Service RestartSec=100ms expired, scheduling restart. May 7 14:37:14 XabiX systemd[1]: shadowsocks-libev-manager@manager.service: Scheduled restart job, restart counter is at 3. May 7 14:37:14 XabiX systemd[1]: Stopped Shadowsocks-Libev Custom Manager Service for manager. May 7 14:37:14 XabiX systemd[1]: Started Shadowsocks-Libev Custom Manager Service for manager. May 7 14:37:14 XabiX ss-manager[25405]: 2020-05-07 14:37:14 ERROR: 7:0: Expected : before " May 7 14:37:14 XabiX systemd[1]: shadowsocks-libev-manager@manager.service: Main process exited, code=exited, status=255/EXCEPTION May 7 14:37:14 XabiX systemd[1]: shadowsocks-libev-manager@manager.service: Failed with result 'exit-code'. May 7 14:37:14 XabiX systemd[1]: shadowsocks-libev-manager@manager.service: Service RestartSec=100ms expired, scheduling restart. May 7 14:37:14 XabiX systemd[1]: shadowsocks-libev-manager@manager.service: Scheduled restart job, restart counter is at 4. May 7 14:37:14 XabiX systemd[1]: Stopped Shadowsocks-Libev Custom Manager Service for manager. May 7 14:37:14 XabiX systemd[1]: Started Shadowsocks-Libev Custom Manager Service for manager. May 7 14:37:14 XabiX ss-manager[25406]: 2020-05-07 14:37:14 ERROR: 7:0: Expected : before " May 7 14:37:14 XabiX systemd[1]: shadowsocks-libev-manager@manager.service: Main process exited, code=exited, status=255/EXCEPTION May 7 14:37:14 XabiX systemd[1]: shadowsocks-libev-manager@manager.service: Failed with result 'exit-code'. May 7 14:37:14 XabiX systemd[1]: shadowsocks-libev-manager@manager.service: Service RestartSec=100ms expired, scheduling restart. May 7 14:37:14 XabiX systemd[1]: shadowsocks-libev-manager@manager.service: Scheduled restart job, restart counter is at 5. May 7 14:37:14 XabiX systemd[1]: Stopped Shadowsocks-Libev Custom Manager Service for manager. May 7 14:37:14 XabiX systemd[1]: shadowsocks-libev-manager@manager.service: Start request repeated too quickly. May 7 14:37:14 XabiX systemd[1]: shadowsocks-libev-manager@manager.service: Failed with result 'exit-code'. May 7 14:37:14 XabiX systemd[1]: Failed to start Shadowsocks-Libev Custom Manager Service for manager. May 7 14:37:23 XabiX omr-service[25314]: /etc/glorytun-udp/post.sh: 3: .: : not found May 7 14:37:23 XabiX omr-service[25314]: /etc/glorytun-tcp/post.sh: 3: .: : not found May 7 14:37:33 XabiX omr-service[25314]: /etc/glorytun-udp/post.sh: 3: .: : not found May 7 14:37:33 XabiX omr-service[25314]: /etc/glorytun-tcp/post.sh: 3: .: : not found May 7 14:37:44 XabiX omr-service[25314]: /etc/glorytun-udp/post.sh: 3: .: : not found

The json file after executing the scrip is back with 2 lines as:

"port_key": {
    "65101" "WpHPWs4LTD3ZL_xxx",
    "65101" "WpHPWs4LTD3ZL_xxx",
},

FYI I subscribed to another VPS and therefore reinstalled and now working! Not sure why I had the issue and if people will have it to when upgrading but at least you got my details in case you can spot an issue. MERCI

weltmeyer commented 4 years ago

the post.sh problem is existing for me too, fresh VM directly installed script.

after some research i found that: for intf in /etc/glorytun-udp/*; do returns the full path so, the readlink does: readlink -f /etc/glorytun-udp//etc/glorytun-udp/tun0 which is wrong, as it should do readlink -f /etc/glorytun-udp/tun0 same is for the omr6-4 parts.

caller for glorytun-udp: omr-service, line 22 /etc/glorytun-udp/post.sh /etc/glorytun-udp/${intf} intf is already /etc/glorytun-udp/tun0

VoightKampff commented 4 years ago

I noticed that I am getting a lot of drop outs / flapping. Here's the system log: https://gist.github.com/VoightKampff/c0922bb0d2c12441a903ef94bfb5963c I'm also running 0.54.7 and it reports no errors such as kern.err kernel: [340259.286623] __mptcp_init4_subsockets mptcp_add_sock failed ret: -1 in 0.54.7. It is of course running with a different VPS instance, but in the same data center from the same provider (OVH Warsaw DC).

vobo70 commented 4 years ago

Somebody answered in my topic on Banana PI R2 forum as related to very slow LAN speed:

I saw yesterday a new patch related to VLAN was applied in the latest 5.4 kernel tree and I guess it will be available in the next release.

https://patchwork.kernel.org/patch/11552461/

Allow DSA to add VLAN entries even if VLAN filtering is disabled, so enabling it will not block the traffic of existent ports in the bridge

I’m not sure if this is related to the traffic slowness I have not tested it.

Ysurac commented 4 years ago

True, patches seems to be already applied :) I will test speed.

vobo70 commented 4 years ago

I made some test and connected this card: USB 3.0 ASIX Elec. Corp. AX88179 USB 3.0 to 1GbE LAN adapter and the speed is OK:

maciek@bananapipro2:~$ iperf3 -c 192.168.1.1 Connecting to host 192.168.1.1, port 5201 [ 5] local 192.168.1.22 port 43650 connected to 192.168.1.1 port 5201 [ ID] Interval Transfer Bitrate Retr Cwnd [ 5] 0.00-1.00 sec 18.6 MBytes 155 Mbits/sec 0 844 KBytes [ 5] 1.00-2.00 sec 16.8 MBytes 141 Mbits/sec 0 1.63 MBytes [ 5] 2.00-3.01 sec 16.2 MBytes 135 Mbits/sec 0 2.42 MBytes [ 5] 3.01-4.00 sec 15.0 MBytes 127 Mbits/sec 0 3.20 MBytes [ 5] 4.00-5.01 sec 16.2 MBytes 136 Mbits/sec 0 3.48 MBytes [ 5] 5.01-6.02 sec 16.2 MBytes 135 Mbits/sec 0 3.48 MBytes [ 5] 6.02-7.01 sec 16.2 MBytes 137 Mbits/sec 0 3.61 MBytes [ 5] 7.01-8.02 sec 16.2 MBytes 135 Mbits/sec 0 3.79 MBytes [ 5] 8.02-9.02 sec 16.2 MBytes 137 Mbits/sec 0 3.79 MBytes [ 5] 9.02-10.00 sec 16.2 MBytes 138 Mbits/sec 0 3.79 MBytes

[ ID] Interval Transfer Bitrate Retr [ 5] 0.00-10.00 sec 164 MBytes 138 Mbits/sec 0 sender [ 5] 0.00-10.19 sec 164 MBytes 135 Mbits/sec receiver

I understand that the problem is related to onboard Realtek LAN controlller.

Ysurac commented 4 years ago

He is talking about BPI-R2, not RPI. I need to make tests to find why it's slow.

xabix commented 4 years ago

FYI when 'updating the VPS script' at the end I got:

[Sun May 17 20:31:09 UTC 2020] Create new order error. Le_OrderFinalize not found. { "type": "urn:ietf:params:acme:error:rateLimited", "detail": "Error creating new order :: too many certificates already issued for: ovh.net: see https://letsencrypt.org/docs/rate-limits/", "status": 429 }

Ysurac commented 4 years ago

@xabix if the script doesn't stop here it's not a big issue: cert are used for v2ray based on reverse of the VPS IP.

vobo70 commented 4 years ago

Banana PI R2 - openmptcprouter 0.55 beta 4 when I connect USB 3.0 SSD the device does not appear in /dev/sd* only I can see that in dmesg: [ 3.852621] usb-storage 2-1.1:1.0: no of_node; not parsing pinctrl DT [ 3.852771] usbcore: registered new interface driver usb-storage (besides that the router hangs when I do it "online") what log should I provide to help me?

vobo70 commented 4 years ago

Instead connecting SSD i put 32GB card to Banana PI R2. But for 2-3 days i can see disconnecting varius clients form AP running on BPI_R2. I was running beta4 now I moved to beta5 (clean install). I will report if it still will happends.

JorgeMoort89 commented 4 years ago

Can be implemented Full Cone NAT for additional public IP?

vinceducat commented 4 years ago

@Ysurac any planned date to the 0.55 release ?

Ysurac commented 4 years ago

@JorgeMoort89 I never tested Full Cone NAT, it was requested and validated but I never used this yet.

@vinceducat when it will be ready :) There is never planned date. If I don't find major bug in current beta, release candidate 1 will be ready and I will test it on all arch. If RC1 is ready to production then it will be very soon (I don't think so...). But with some luck 0.55 should be ready next week or beginning of June. For that I need to rent a new server to compile/host images and all packages.

Adorfer commented 4 years ago

If I don't find major bug in current beta,

what kind of input do you need "for natv6 not working even with current beta and fresh install on debian10 vps with fully working public /64"? New issue? Or comment on one of the already closed ones?

vobo70 commented 4 years ago

For that I need to rent a new server to compile/host images and all packages.

can we support you with that "case"? (I'm not reach but it's only way to thank you for your work)

vinceducat commented 4 years ago

@vobo70 nice question how can you help you @Ysurac ?

a VPS can help you ?

kevin39 commented 4 years ago

There is a donate button on https://www.openmptcprouter.com/ :)

Personnally i already donated few days ago. He changed my life ;)

Ysurac commented 4 years ago

@Adorfer This will be fixed in next beta (I have also an error) @vobo70 I want to own the server, I want to host also a translation tool for the interface. Then I will try to make possible to have some small mirrors and I will ask help here ;) @vinceducat not for now, I have many. But they may be nice for mirrors when this will be available @kevin39 and thanks for that, this will help to pay the new server :)

salchris commented 4 years ago

There is a donate button on https://www.openmptcprouter.com/ :)

Personnally i already donated few days ago. He changed my life ;)

Yes.. i think this is the best way. A small donation is a must.

Thank you Ysurac.

Adorfer commented 4 years ago

despite having joined one of the patreon plans: i can offer a (new) VPS with a dedicated NVME and some 12 cores (out of 32/64HT). currently the host machine is used to build full chain OpenWRT (here: Freifunk-Gluon). For the benchmark: If the target's toolchain is already build, a full target takes 55min each. Platform either jenkins or plain debian.

Ysurac commented 4 years ago

@Adorfer thanks for the offer. For now my issue is more related to disk space and memory. For the build process I will see how I can use multiples servers.

Adorfer commented 4 years ago

i can offer 500GB SSD and 16GB of RAM dedicated for this vps. it's just lacking a bit of connectivity: just 30MBit/s upload (it's sitting a basement rack connected via -surprise, surprise- openmptcprouter).

krissfr commented 4 years ago

Hi Yannick,

will you provide an ubuntu 20.04 VPS script when the 0.55 will be release ?

thank you

tentious commented 4 years ago

I'm running latest Beta 7 with latest VPS admin script. With Shadowsocks enabled, I'm having trouble connecting to my Arlo cameras. This didn't happen in 0.54. Glorytun TCP is now working(my preferred VPN) and I'm not running all connections via Glorytun. If I enable Shadowsocks, everything seems to work perfectly, except for connecting to the Arlo cameras. Very strange and haven't noticed any other effects. Since I use Arlo cameras as baby monitors, this is a show stopper, so I've disabled Shadowsocks for now.