search

wnfs-wg / roadmap

The roadmap provides information on future improvements to WNFS and their priorities/timelines. It also helps *you* participate in this process. What can you contribute? Help us accomplish things faster!
5 stars 0 forks source link

Big Dataset Support #10

Open matheus23 opened 1 year ago

matheus23 commented 1 year ago

Summary

Widening the possible use cases to include bigger data sets.

Problem / Need / Opportunity

Due to practical IPFS block size restrictions, WNFS can only safely encode up to 1000-2000 directory entries in public and private directories.

Success Scenario

It's possible to create huge directories! We enable use cases like on-boarding bigger data sets comparable to all of wikipedia, the linux kernel or a nix cache.

Children

ETA: 2023-09-30

Notes

https://github.com/wnfs-wg/spec/issues/8

RangerMauve commented 1 year ago

Would be cool to talk about Prolly Trees around when this happens. We're hoping to have some tests figured out by april on prolly trees to see how the performance works.