banyancomputer / banyan-cli

Banyan's client, BanyanFS+CAR encrypted filesystem packer and metadata handler.
https://banyan.computer/
MIT License
25 stars 2 forks source link

Vera/ENG-305 Block Tracking #265

Closed organizedgrime closed 11 months ago

organizedgrime commented 12 months ago

https://github.com/banyancomputer/banyan-core/pull/137

linear[bot] commented 12 months ago
ENG-305 Block Tracking

Our platform doesn't know when we can discard old blocks. We need a way to trim out data that has gone outside of our versioning and storage window. The only place that has this information is inside Tomb during delta generation. We need to track if any blocks (identified by CID) are no longer directly referenced by the WNFS filesystem after changes has occurred. I would expect to see one or more entries for each file that was deleted (I believe folders only change the metadata content and wouldn't require a re-upload). This data should be included in the metadata upload payload to the metadata service. Why: Trash collection mgmt bc we can't view metadata itself NB: written in Tomb