Consider using Rkyv for serialization

subsquid / sqd-network

A network of decentralized archives

GNU Affero General Public License v3.0

6 stars 1 forks source link

Consider using Rkyv for serialization #101

Open Wiezzel opened 6 months ago

Wiezzel commented 6 months ago

We need to hack protobuf to achieve deterministic serialization, e.g. here.

Rkyv is a zero-copy serialization library for Rust. It could be a viable alternative to protobuf.

Has deterministic serialization,
Is significantly faster than prost (benchmarks),
Has lower memory footprint, because it supports string re-use (shared pointers).

Wiezzel commented 3 months ago

It's rust-only and is not fully specified. Therefore, rewards bot (written in JS) would have trouble validating query log signatures. Borsh seems to be a better candidate.