Investigate compression options

spacemeshos / pm

Project management. Meta-tasks related to research, dev, and specs for the Spacemesh protocol and infrastructure.

http://spacemesh.io/

Creative Commons Zero v1.0 Universal

2 stars 0 forks source link

Investigate compression options #110

Open lrettig opened 2 years ago

lrettig commented 2 years ago

For on the wire, and in database/on disk. Options:

https://en.wikipedia.org/wiki/Snappy_(compression)

lrettig commented 7 months ago

@dshulyak do you think this is still relevant? Do we have any sort of compression built into our p2p stack already?

dshulyak commented 7 months ago

sqlite doesn't compress data. there are extensions that can do that. libp2p doesn't compress data by itself. we can check what is the latest useful compression and check compression rate for our data, i had an experiment long time ago and snappy gave about ~5%.