djkoloski / rust_serialization_benchmark

Benchmarks for rust serialization frameworks
514 stars 48 forks source link

add cbor4ii to benchmarks #56

Closed quininer closed 6 months ago

quininer commented 6 months ago

:)

djkoloski commented 6 months ago

Looks like you just need to rerun cargo fmt. Make sure to pull first, I added one commit to pin the cbor4ii version to 0.3.1.

quininer commented 6 months ago

Since the old version of simd-json was revoked, I have to update it.

You may want to keep Cargo.lock to avoid this.

djkoloski commented 6 months ago

Thanks for the PR! Sorry about broken CI, I did a quick pass to fix that up.

djkoloski commented 6 months ago

The regex for parsing log outputs wasn't matching crates with numbers in their names. I've fixed that and stats for cbor4ii now appear in the README.

quininer commented 6 months ago

The results look worse than I expected, cbor4ii performs better than serde_cbor on all my test devices (amd, intel, aarch64), but not on github actions.

djkoloski commented 6 months ago

Are you testing with these benchmarks or another set of benchmarks?

quininer commented 6 months ago

Using this benchmark, my local first bench can get a score of 700us before submit, but only 1.3ms after merge.

20231102-120704 ^ before submit

Screenshot_20231102_121252 ^ after merge