search

fsmosca / chess-artist

A python script that can annotate chess games in pgn file with static evaluation or search score of an engine, can annotate an epd file with acd, acs, bm, and ce opcodes, can test engine with epd test suite and can generate chess puzzles.
GNU General Public License v3.0
69 stars 18 forks source link

Don't restart engine when solving a test suite #71

Closed fsmosca closed 4 years ago

fsmosca commented 4 years ago

Testing dev version

Console

...
EPD 300: b2b1r1k/3R1ppp/4qP2/4p1PQ/4P3/5B2/4N1K1/8 w - - bm g6; id "WAC.300";
FEN 300: b2b1r1k/3R1ppp/4qP2/4p1PQ/4P3/5B2/4N1K1/8 w - - 0 1
engine bm: Ra7
correct: No
num correct: 62 / 300
:: EPD EPD/wacnew.epd TEST RESULTS ::
Engine                : Lc0 v0.23.2+git.c8d9095
Time/pos (sec)        : 1.0

Total epd lines       : 300
Total tested positions: 300
Total correct         : 62
Correct percentage    : 20.67

Elapse (sec)          : 282.68
Done!!

Total ideal time = 300 pos x 1s / pos = 300s Elapse = 282.68s

Lc0 returns its bestmove early.

2020-01-12 12:01:42,242 :: pid: 8484 :: tid: 22068 :: DEBUG :: >> position fen b2b1r1k/3R1ppp/4qP2/4p1PQ/4P3/5B2/4N1K1/8 w - - 0 1
2020-01-12 12:01:42,242 :: pid: 8484 :: tid: 22068 :: DEBUG :: >> go movetime 1000
2020-01-12 12:01:42,545 :: pid: 8484 :: tid: 22068 :: DEBUG :: << info depth 1 seldepth 2 time 257 nodes 5 score cp 63 hashfull 0 nps 20 tbhits 0 pv f6g7 h8g7
2020-01-12 12:01:42,795 :: pid: 8484 :: tid: 22068 :: DEBUG :: << info depth 2 seldepth 3 time 503 nodes 7 score cp 21 hashfull 0 nps 14 tbhits 0 pv f6g7 h8g7 e2g3
2020-01-12 12:01:43,045 :: pid: 8484 :: tid: 22068 :: DEBUG :: << info depth 3 seldepth 4 time 748 nodes 19 score cp -26 hashfull 0 nps 25 tbhits 0 pv d7a7 a8c6 e2g3 g7f6
2020-01-12 12:01:43,091 :: pid: 8484 :: tid: 22068 :: DEBUG :: << info depth 3 seldepth 4 time 792 nodes 21 score cp -7 hashfull 0 nps 26 tbhits 0 pv d7a7 a8c6 e2g3 g7f6 a7a8
2020-01-12 12:01:43,091 :: pid: 8484 :: tid: 22068 :: DEBUG :: << bestmove d7a7 ponder a8c6
2020-01-12 12:01:43,091 :: pid: 8484 :: tid: 22068 :: INFO :: engine bm: Ra7
2020-01-12 12:01:43,091 :: pid: 8484 :: tid: 22068 :: INFO :: correct: No
2020-01-12 12:01:43,091 :: pid: 8484 :: tid: 22068 :: INFO :: num correct: 62 / 300
2020-01-12 12:01:43,091 :: pid: 8484 :: tid: 22068 :: DEBUG :: >> quit

Will issue the exe later.