search

LilithHafner / InterLanguageSortingComparisons

6 stars 2 forks source link

Reproducible performance #5

Open gitboy16 opened 1 year ago

gitboy16 commented 1 year ago

Hi,

The way you benchmark the sorting algorithms obviously depends on the hardware you are using. From a previous issue I opened you can see that depending on the hardware Julia is not the fastest, nor the most memory efficient solution.

I don't have a solution to that but it would be great to find a way for people to be able to reproduce the perfomance that you are displaying.

I was wondering if it is possible to run these benchmarks on a github server or equivalent enviornnment where people can actually reproduce things.

Thank you Kind regards

LilithHafner commented 1 year ago

Unfortunately, I do not have the bandwidth to configure 8 different languages on a remote server. Feel free to submit a PR, though!

dumblob commented 1 year ago

I think it would be enough to get rid of numeric sorting and suddenly the performance should be much more reproducible if not "always everywhere".

See https://github.com/LilithHafner/InterLanguageSortingComparisons/issues/11 .

LilithHafner commented 1 year ago

Reproducibility is separate from having a diverse set of benchmarks—though both are important and lacking here.