simd-lite / simd-json-derive

high performance Serialize and Deserialize derives
Apache License 2.0
30 stars 7 forks source link

Work with simdjson-rust? #56

Closed v1gnesh closed 9 months ago

v1gnesh commented 10 months ago

Came across the benchmark recently, and just wondering how big of a project it is to get sjd to work with simdjson-rust, in addition to the current simd-json port.

Licenser commented 10 months ago

It will be quite hard, the derive is so efficient because it is tailored to the implementation.

I also recommend to take that benchmark with a very big grain of salt. As far as I remember the upstream (c) implementation of simdjson what it returns as a DOM is the tape. While both simd-json and serde create a actual nested data structure. You could create the tape in simd-json too which would be a lot closer to the upstream numbers. It's not that they are cheating but it is comparing two different things which makes little sense.

Licenser commented 10 months ago

@v1gnesh I opened a issue with the benchmark detailing the problem: https://github.com/SunDoge/simdjson-rust/issues/26