PascalPons / connect4

Connect 4 Solver
GNU Affero General Public License v3.0
278 stars 51 forks source link

How to reproduce the benchmarks #22

Open certik opened 3 years ago

certik commented 3 years ago

Here is how I can reproduce the timing benchmarks (sort of), e.g. the Middle-Medium:

$ wget https://blog.gamesolver.org/data/Test_L2_R2
$ cat Test_L2_R2 | cut -d " " -f 1 | time ./c4solver -w
...
1.74user 0.02system 0:01.76elapsed 99%CPU (0avgtext+0avgdata 84720maxresident)k
0inputs+0outputs (0major+20617minor)pagefaults 0swaps

So it prints 1.76s per 1000 benchmarks, which gives 1.76ms per benchmark on average. That is close to your benchmarks which give 1.717 ms median for the "weak solver".

How do you compute median and print the number of positions?