itamarst / eliot

Eliot: the logging system that tells you *why* it happened
https://eliot.readthedocs.io
Apache License 2.0
1.1k stars 66 forks source link

Faster JSON encoding #372

Closed itamarst closed 10 months ago

itamarst commented 5 years ago

https://github.com/ijl/orjson seems nice and fast. Otherwise, rapidjson is next on the list.

itamarst commented 5 years ago

So far orjson seems a little fast, but not as much as expected. Should also try rapidjson.

Another alternative might be a different storage format, e.g. http://zderadicka.eu/comparison-of-json-like-serializations-json-vs-ubjson-vs-messagepack-vs-cbor/ suggests CBOR is rather faster.

itamarst commented 5 years ago

More thorough benchmarking suggested orjson is definitely faster: https://pythonspeed.com/articles/faster-json-library/