CSSLab / maia-chess

Maia is a human-like neural network chess engine trained on millions of human games.
https://maiachess.com
GNU General Public License v3.0
963 stars 121 forks source link

Human accuracy comparison to Good/Bad/Mean/Evil Gyal? #21

Open clawsoon opened 3 years ago

clawsoon commented 3 years ago

@dkappe has trained a number of nets on Lichess data, with some Stockfish mixed in to fill in gaps where the Lichess data tends to be sparse (e.g. endgames after a material imbalance, where human players in most games resign). Any chance you'd be able to do a "how human does it play?" comparison against his nets to see how they stack up against the Maia nets? I've been playing the Maia 1100 net, and it misses some very obvious moves that an 1100 human would make (e.g. Maia 1100 sometimes fails to take back during an exchange, leaving the game lost). I'm wondering if his mix of human and Stockfish data might create a "more human" player than human data alone. And since you've already got the code to make those comparisons between human play and engine play... ;-)

https://github.com/dkappe/leela-chess-weights/wiki/Mean-Girl:--the-most-fun-leela-style-net https://github.com/dkappe/leela-chess-weights/wiki/Bad-Gyal