search

diba-io / carbonado

An apocalypse-resistant data storage format for the truly paranoid.
MIT License
105 stars 7 forks source link

Split file into chunks #31

Open amiyatulu opened 1 month ago

amiyatulu commented 1 month ago

How can I split file into chunks, and store the chunks in different peer (using rust-libp2p), and the verify chunks by downloading chunks from different peers, without downloading the complete file.

cryptoquick commented 1 month ago

That would be pretty cool! We do something kind of similar to the first part in the Carbonado Node, splitting each file out over different drives. As for rust-libp2p, I don't really know, but that would be pretty cool!

Maybe I can add a function that can split the file into 8 different chunks if using forward error correction (any format c7+), so I'll keep this open.