lynx-chess / Lynx

Chess Engine, written in C#
https://lichess.org/@/Lynx_BOT
MIT License
39 stars 3 forks source link

Tune eval using 50m pedantic data #904

Closed eduherminio closed 1 month ago

eduherminio commented 1 month ago

Attempted in https://github.com/lynx-chess/Lynx/pull/855 before king bucketed PSQTs

# Path, WDL from side playing, position limit
../../datasets/pedantic_master_training_data_ver7.0d_50m_wdl.csv,0,0
Test  | eval/retune-pedantic-50m-50k
Elo   | -57.16 +- 15.26 (95%)
SPRT  | 8.0+0.08s Threads=1 Hash=32MB
LLR   | -2.29 (-2.25, 2.89) [0.00, 3.00]
Games | 1294: +349 -560 =385
Penta | [108, 171, 229, 102, 37]
https://openbench.lynx-chess.com/test/577/
Test  | eval/retune-pedantic-50m-15k
Elo   | -69.53 +- 17.31 (95%)
SPRT  | 8.0+0.08s Threads=1 Hash=32MB
LLR   | -2.27 (-2.25, 2.89) [0.00, 3.00]
Games | 1114: +284 -504 =326
Penta | [112, 147, 180, 85, 33]
https://openbench.lynx-chess.com/test/576/