streambed / streambed-rs

Event driven services toolkit
Apache License 2.0
31 stars 5 forks source link

Support CRC error detection #43

Closed huntc closed 1 year ago

huntc commented 1 year ago

My new CRC feature to postcard is used to detect errors when reading data back. Note that any existing logged data files must be deleted as they are not going to be compatible. Automated recovery is not implemented for history files.

I note an increase in mips32 binary size of 4KiB (no biggie), plus a degradation in consumer performance. I guess that's because of the CR32C check being performed. We're still at over 3 million records per second though, so I'm not concerned.

huntc commented 1 year ago

I'm going to merge along with the PR patch. If the PR isn't accepted for some reason (it should be though) then we can move the CRC checking module into here quite easily.