search

lbryio / lbry-sdk

The LBRY SDK for building decentralized, censorship resistant, monetized, digital content apps.
https://lbry.com
MIT License
7.19k stars 482 forks source link

Understand and/or design system on how to measure disk space available #3463

Closed kauffj closed 2 years ago

kauffj commented 2 years ago

And/or content availability overall

shyba commented 2 years ago

Some articles I found related to estimating the network size: https://www.irjet.net/archives/V5/i12/IRJET-V5I1208.pdf https://eli.sohl.com/2020/06/05/dht-size-estimation.html https://www.cl.cam.ac.uk/~lw525/MLDHT/

First phase will be adding more metrics options to the DHT seed node, so an operator can use it to see data about the network partition it belongs. Then this data can be used to estimate the other partitions.

Some idea: fetch from blockchain data (hubs?) how many SD blob hashes there are for a partition and compare to how many we have seen. The ratio of existing/announced should tell how much of it is hosted initially.