libp2p / observer-toolkit

🐣 [WIP] toolkit for building libp2p introspection widgets + a few useful out-of-the-box widgets
https://libp2p.io
MIT License
2 stars 2 forks source link

document work expected to change the protocol and file format #15

Closed GlenTiki closed 4 years ago

GlenTiki commented 4 years ago

TODO:

This PR outlines some of the many changes needed over the coming week to the file format and live protocol.

We need to further allow the client to (1) subscribe to, (2) unsubscribe from, (3) pause and (4) unpause push based streams. This is all now supported via the protocol as specified.

Since we need to wrap the snapshot in a further protobuf to denote the message type that has been received, it is possible for us to separate out the static metadata from the system snapshot to save this static data being transferred multiple times, and only send it once.

The file format now has checksum support for messages within it. This checksum is a hash generated as fnv1a 32bit.