The foundation of Hivemind building blocks are functional, tested, and ready for further development. P2P communication does work, peers will automatically discover each other via public relays, and some basic error handling has been implemented (to combat the unreliable nature of decentralized training).
A lot more needs to be done here, but I wanted to merge this code before the branch becomes too huge.
The foundation of Hivemind building blocks are functional, tested, and ready for further development. P2P communication does work, peers will automatically discover each other via public relays, and some basic error handling has been implemented (to combat the unreliable nature of decentralized training).
A lot more needs to be done here, but I wanted to merge this code before the branch becomes too huge.