quorumcontrol / dgit

dgit adds decentralized ownership to git - powered by Tupelo DLT and Skynet
https://dgit.dev/
MIT License
208 stars 16 forks source link

Upload packfiles directly to Sia #41

Open cap10morgan opened 4 years ago

cap10morgan commented 4 years ago

This should improve performance by uploading packfiles directly to Sia Skynet rather than parsing them into individual objects and uploading those. We'll have to keep track of what's in each packfile in the chaintree (see the filesystem storage in go-git for reference). Presumably we'll want to cache them after downloading so that any other object read requests for things in the same packfile will already have what they need. That should improve cloning / pulling performance quite a bit.

MizunaRei commented 4 years ago

https://filebase.com/ runs a cache service for sia. It really fast. DGIT could run a cache server cloud or locally.