search

RubenKelevra / pacman.store

Pacman Mirror via IPFS for ArchLinux, Endeavouros, Manjaro plus custom repos ALHP and Chaotic-AUR.
GNU General Public License v3.0
109 stars 5 forks source link

Create more documentation in IPFS about BloomFilter #47

Open RubenKelevra opened 3 years ago

RubenKelevra commented 3 years ago

There need to be more documentation on the BloomFilter option in IPFS. This ticket is about tracking this process.

@Luflosi wrote

I found the Datastore.BloomFilterSize option, which sounds like it has the potential to speed up pinning operations but I couldn't find any documentation on what it actually does. > Do you know?

Originally posted by @Luflosi in https://github.com/RubenKelevra/pacman.store/issues/42#issuecomment-765376035

RubenKelevra commented 3 years ago

@RubenKelevra wrote

@Luflosi wrote

I found the Datastore.BloomFilterSize option, which sounds like it has the potential to speed up pinning operations but I couldn't find any documentation on what it actually does. Do you know?

Well, it's an interesting feature, but you need to tune it depending on the amount of CIDs you store. It replaces a "let's check if we got that data already" with a "let's have a calculation which gives us with 99.xx% certainty the same result".

It's definitely faster, but rarely used. That's why I stay away from it in my daily IPFS usage.

I don't know what happens when we cannot deliver 0.xx percent of the blocks, because their checksums was too similar, but I guess it wouldn't be pretty.