search

miloyip / nativejson-benchmark

C/C++ JSON parser/generator benchmark
MIT License
1.98k stars 261 forks source link

Json Spirit is mentioned in the list of 43 libraries but not in the test results. Why? #110

Open RokerHRO opened 5 years ago

RokerHRO commented 5 years ago

The table of the 43 libraries contains "json spirit" with version 4.08, but I cannot find any test results. Why? Does it not parse the test data?

boazsegev commented 4 years ago

AFAIK, the results were last updated in 2016.

To view updated results, with all the updated libraries, compile and run the project on your machine.

RokerHRO commented 4 years ago
  1. "last updated in 2016" is no excuse to list a certain library first but don't mention it in the results. Perhaps there was a reason for it? I don't know.
  2. It is far more complicated for me to install all the competitors than it would be for the author of the project who had already done it. And when the results depend on the specific machine and OS it would not help if I just try it now on my machine.
boazsegev commented 4 years ago

@RokerHRO ,

I truly understand your sentiment. I'm not the author for this repo, I am a user, much like yourself and running the benchmarks was a struggle (you can see my results here).

However, I also understand that benchmarking costs money and time. Moreover, the results are often machine specific.

I wish the author was sponsored and automated benchmarks were run after every PR... however, this does not appear to be the case.

The author was kind enough to donate their time and resources, sharing their knowledge to help the community... This is a gift we were given.

Of course, there is always more to do... but it's free, so there it is. Nothing to say but "thank you".