ipfs-shipyard / integration-mini-projects

Ideas and tracking for small one week "mini projects" that integrate across IPFS
MIT License
14 stars 2 forks source link

ipfs/distributions is very innefficient #16

Open hsanjuan opened 5 years ago

hsanjuan commented 5 years ago

Our https://github.com/ipfs/distributions builds the dist.ipfs.io page. However, for every project in that page, it uses ipfs to fetch the full size of dist.ipfs.io and copy it into temp.

If you have never fetched it before it will take ages to download. If you have, it will still copy gigabytes of data from the ipfs blockstore to /tmp on every project build.

We should not be downloading all of dist to be able to update it. The ipfs files commands provide mechanisms to do this.