ostafen / smart

String Matching Algorithms Research Tool
https://smart-tool.github.io/smart/
GNU General Public License v3.0
4 stars 2 forks source link

Suggestion: set default number of iterations to 1000. #10

Closed nishihatapalmer closed 5 months ago

nishihatapalmer commented 2 years ago

Will give more benchmarking accuracy, and we have speed to spare now that algos are opened with dlopen() rather than execing a new process for each iteration.

nishihatapalmer commented 1 year ago

Good to measure variability with a different number of runs, and quantify it.

nishihatapalmer commented 1 year ago

On the other hand, if we start measuring different processes and use a larger text size by default, 1000 runs could be too long.

Let's figure out what the optimum runs / processes / text sizes are for good general measurement.

nishihatapalmer commented 5 months ago

Default of 500 is fine. Longer search texts seem to be more important than number of different patterns of the same length.