qizhou
commented
1 year ago -
Encoder/Decoder
- Masked + Xor or VDF
- encode(BLOB, encodeKey = hash(kvIdx || commit(BLOB) || storagePrvoiderAddr)
- unpredictable, unique to replica, unique to different positions
- encodeSize can be greater than chunkSize (more flexible)
- only require chunkSize <= BLOBSize
-
DataFile is not responsible for encoding/decoding
- Raw chunk read/write and chunk range
-
DataShard manages encoding/decoding
- Write encoded data or read data and decode it
- Translate KV read/write to chunk read/write
- Read encoded data
-
ShardManager manages multi-shard
merge
--miner => --sstorage.miner
use common.Hash for commit
fix merge bug
add header.maskType for upgradability
Revert " --miner => --sstorage.miner"
This reverts commit 22a2ecce4e566349d817b9f0fc1ccd4187e6d645.
TODO mod synchronize
Co-authored-by: zhiqiangxu 652732310@qq.com