ECP-VeloC / redset

Low-level distributed erasure coding library to protect datasets of MPI applications
MIT License
2 stars 3 forks source link

reed-solomon #9

Closed adammoody closed 4 years ago

adammoody commented 4 years ago

First version of a Reed-Solomon option. This divides processes into sets, like our XOR scheme, but it applies a Reed-Solomon encoding to each group so that files from multiple ranks can be recovered in each group. It is currently hard coded to use 2 encoding blocks, so we can recover from 2 failed ranks in each group. Obviously, that should be something the user can specify.