search

ipfs-inactive / faq

[ARCHIVED] DEPRECATED, please use https://discuss.ipfs.io! Frequently Asked Questions
164 stars 11 forks source link

Which chunking algorithms are available? #214

Closed JustinDrake closed 7 years ago

JustinDrake commented 7 years ago

The ipfs add command has the following flag:

-s, --chunker string - Chunking algorithm to use.

What chunking algorithms are available?

JustinDrake commented 7 years ago

See here. The default is to use a block size of DefaultBlockSize int64 = 1024 * 256. Another block size can be specified using size-*. There's also the rabin-* chunker which uses rabin-[min]-[avg]-[max].

JustinDrake commented 7 years ago

As far as I can tell, the Rabin chunker is a "Content Defined Chunker" to improve deduplication. See here.

madavieb commented 7 years ago

This issue has been moved to https://discuss.ipfs.io/t/which-chunking-algorithms-are-available/363.