decentralize p2p network

spacemeshos / pm

Project management. Meta-tasks related to research, dev, and specs for the Spacemesh protocol and infrastructure.

http://spacemesh.io/

Creative Commons Zero v1.0 Universal

2 stars 0 forks source link

decentralize p2p network #275

Open dshulyak opened 7 months ago

dshulyak commented 7 months ago

the problem with existing setup is that many nodes are undialable and therefore spacemesh has to run CDN-like nodes (that we call boosters internally) that help with network connectivity.

this is not good for network long term health and we want to fix it when time allows. in the past we failed with libp2p hole punching protocol, but it could be due to rushing things. we want to:

enable quic / webrtc transport
retest hole punching protocol
measure it

this doesn't introduce any immediate issues, but not good for network health long term

ivan4th commented 3 weeks ago

With P2P decentralization (#5329) and fetch streaming (#5562) merged, we're currently trying to enable decentralization features in the network. The current problem appears that the routing discovery mechanism causes too much network load on the user nodes.

The following items are planned:

https://github.com/spacemeshos/go-spacemesh/pull/5815: increase and randomize routing discovery advertisement interval
enable QUIC on the network (better hole-punching efficiency)
slow down routing discovery mechanism

ivan4th commented 2 weeks ago

Testing QUIC on the testnet. There was an issue with malfeasance sync on testnet, fixed: spacemeshos/go-spacemesh#5851

Looking into reports that streaming mode is somehow causing too many TCP connections (?)

ivan4th commented 5 days ago

spacemeshos/go-spacemesh#5792 should facilitate diagnostics of possible network issues after we try to enable decentralization next time. It would be best to include corresponding views in SMAPP.

spacemeshos/go-spacemesh#5882 should reduce network strain due to DHT and connection activity after routing discovery is enabled