jhonnold / berserk

UCI Chess Engine written in C
GNU General Public License v3.0
198 stars 30 forks source link

Berserk-12-Official release (Windows_x64_avx2 binary). FRC/Chess960. GUI: Cutechess 1.2. Berserk blunders in one move to lose the games. Some examples. PGN #526

Closed hadynthepadawan closed 8 months ago

hadynthepadawan commented 8 months ago

[Event "My Tournament"] [Site "?"] [Date "2023.11.04"] [Round "4"] [White "Lc0-v0.31-dag-BT3-2860000-Ergodice-tune_1.29"] [Black "berserk-12-x64-avx2_16CPU"] [Result "1-0"] [Variant "chess 960"] [SetUp "1"] [FEN "qbbnnrkr/pppppppp/8/8/8/8/PPPPPPPP/QBBNNRKR w HFhf - 0 1"] [PlyCount "34"] [EventDate "2023.??.??"] [TimeControl "240"]

  1. c4 {0.31/8 13} c5 {-0.17/28 6.0s} 2. Nf3 {0.28/9 4.6s} h5 {-0.14/27 4.3s} 3. h4 {0.24/9 4.6s} Nf6 {-0.12/32 8.8s} 4. b3 {0.20/10 4.6s} b5 {-0.07/30 9.3s} 5. cxb5 {0.16/11 4.6s} a6 {-0.05/28 8.3s} 6. b6 {0.16/10 4.6s} Qb7 {-0.12/31 16} 7. d4 {0.25/11 4.6s} cxd4 {0.05/26 2.7s} 8. Qxd4 {0.28/12 4.6s} Nc6 {0.00/30 3.3s} 9. Qd2 {0.28/14 4.6s} Qxb6 {0.05/32 5.2s} 10. Nc3 {0.29/12 4.6s} d6 {0.00/33 36} 11. Bb2 {0.51/9 4.6s} e5 {0.01/30 7.2s} 12. Rc1 {0.47/10 4.6s} Qxf2+ {#1/200 0.11s} 13. Kxf2 {68.14/6 4.6s} Bb7 {-9.56/29 36} 14. Nd5 {69.44/6 4.6s} Nxd5 {-9.03/29 12} 15. Qxd5 {27.71/6 4.6s} Nd8 {-8.92/28 5.4s} 16. Qd2 {95.87/6 4.6s} Rh6 {-9.36/32 24} 17. Rh3 {106.86/5 4.6s} f5 {-8.57/25 5.1s, White wins by adjudication} 1-0

[Event "My Tournament"] [Site "?"] [Date "2023.11.04"] [Round "2"] [White "berserk-12-x64-avx2_16CPU"] [Black "Lc0-v0.31-dag-BT3-2860000-Ergodice-tune_1.29"] [Result "0-1"] [Variant "chess 960"] [SetUp "1"] [FEN "qnrbbnkr/pppppppp/8/8/8/8/PPPPPPPP/QNRBBNKR w HChc - 0 1"] [PlyCount "17"] [EventDate "2023.??.??"] [TimeControl "240"]

  1. c4 {0.30/30 24} c5 {-0.20/9 15} 2. e3 {0.26/31 0} d6 {-0.14/11 4.6s} 3. b3 {0.41/27 5.6s} b5 {-0.17/15 4.6s} 4. Qxg7+ {#1/27 4.3s} Kxg7 {79.16/1 0.001s} 5. h4 {-9.01/31 23} Rg8 {88.52/5 9.1s} 6. Rh3 {-9.24/31 3.3s} Kh8 {92.35/5 4.6s} 7. Rg3 {-9.09/28 1.7s} Rxg3 {100.35/5 4.6s} 8. Nxg3 {-9.25/29 1.7s} Ng6 {98.63/5 4.6s} 9. Bf3 {-8.43/28 16s, Black wins by adjudication} 0-1

[Event "My Tournament"] [Site "?"] [Date "2023.11.04"] [Round "1"] [White "Lc0-v0.31-dag-BT3-2860000-Ergodice-tune_1.29"] [Black "berserk-12-x64-avx2_16CPU"] [Result "1-0"] [Variant "chess 960"] [SetUp "1"] [FEN "qbbnnrkr/pppppppp/8/8/8/8/PPPPPPPP/QBBNNRKR w HFhf - 0 1"] [PlyCount "42"] [EventDate "2023.??.??"] [TimeControl "240"]

  1. c4 {0.31/8 13} c5 {-0.16/29 7.7s} 2. Nf3 {0.27/10 4.6s} h5 {-0.09/30 13} 3. h4 {0.22/10 4.6s} Nf6 {-0.11/31 15} 4. b3 {0.17/11 4.6s} b5 {-0.03/31 8.4s} 5. cxb5 {0.17/12 4.6s} a6 {-0.11/28 3.8s} 6. Qc3 {0.16/10 4.6s} Ne6 {-0.12/27 4.3s} 7. b6 {0.17/14 4.6s} Bb7 {-0.01/31 8.5s} 8. Qa5 {0.41/11 4.6s} d5 {-0.03/30 6.9s} 9. Ng5 {0.40/14 4.6s} Nd4 {0.00/32 1.2s} 10. Re1 {0.21/14 4.6s} Bd6 {0.00/31 0.36s} 11. Ba3 {0.25/16 4.6s} Nd7 12. e3 {0.41/13 4.6s} Nc6 {0.00/33 0} 13. Qc3 {0.35/12 4.6s} d4 {0.00/31 0} 14. exd4 {0.44/12 4.6s} Nxd4 {0.60/28 2.9s} 15. Ne3 {0.27/18 4.6s} Bxg2 {0.85/26 2.4s} 16. Nxg2 {11.62/7 4.6s} Qxg2+ {#1/200 0.051s} 17. Kxg2 {109.74/1 0.001s} Rh6 {-10.29/27 26} 18. Bxc5 {114.10/6 9.1s} Bxc5 {-8.95/23 2.6s} 19. b4 {114.04/5 4.6s} Bxb6 {-10.34/30 33} 20. Rxe7 {78.10/6 4.6s} Rf6 {-10.55/30 12} 21. Rhe1 {94.34/5 4.6s} Rxf2+ {-11.42/30 28s, White wins by adjudication} 1-0

It seems like in all cases, a queen move is involved in this blunder. Don't know if it is fixed in the dev version. I am posting this just so that you are aware of this behavior in the official build of Berserk-12 i fetched from the github repository of Berserk.

jhonnold commented 8 months ago

Thanks for submitting this issue. I'm able to reproduce all the incorrect "mate in 1s" that the comments are displaying. This is a huge help. I'll be looking for a fix.

position fen 1bb2rkr/5pp1/pqnp1n2/4p2p/7P/1PN2N2/PB1QPPP1/1BR3KR b Kkq - 1 12
go
info string time -1 start 1699713589895 alloc 0 max 2147483647 depth 200 timeset 0 searchmoves 0
info depth 1 seldepth 1 multipv 1 score cp 1 wdl 17 968 15 nodes 37 nps 37000 hashfull 0 tbhits 0 time 1 pv h8h6 
info depth 2 seldepth 2 multipv 1 score cp 118 wdl 661 339 0 nodes 47 nps 47000 hashfull 0 tbhits 0 time 1 pv h8h6 a2a3 
info depth 3 seldepth 3 multipv 1 score cp 118 wdl 661 339 0 nodes 80 nps 80000 hashfull 0 tbhits 0 time 1 pv h8h6 a2a3 b6b3 
info depth 4 seldepth 4 multipv 1 score cp 150 wdl 872 128 0 nodes 116 nps 116000 hashfull 0 tbhits 0 time 1 pv h8h6 a2a3 b6b3 a3a4 
info depth 5 seldepth 6 multipv 1 score cp -83 wdl 1 681 318 nodes 1483 nps 1483000 hashfull 0 tbhits 0 time 1 pv b6b7 c3d5 f6d5 d2d5 c6d8 
info depth 6 seldepth 6 multipv 1 score cp -140 wdl 0 178 822 nodes 2305 nps 2305000 hashfull 1 tbhits 0 time 1 pv b6b7 c3e4 d6d5 e4f6 g7f6 
info depth 7 seldepth 8 multipv 1 score cp -14 wdl 9 962 29 nodes 3008 nps 1504000 hashfull 1 tbhits 0 time 2 pv b6b7 
info depth 8 seldepth 7 multipv 1 score cp 22 wdl 39 954 7 nodes 3476 nps 1738000 hashfull 1 tbhits 0 time 2 pv f6g4 e2e3 h8h6 b2a3 
info depth 9 seldepth 10 multipv 1 score cp -38 wdl 3 924 73 nodes 11490 nps 1641428 hashfull 5 tbhits 0 time 7 pv h8h6 b2a3 c8g4 a3d6 b8d6 d2d6 f8d8 
info depth 10 seldepth 11 multipv 1 score cp -30 wdl 5 942 53 nodes 18353 nps 1668454 hashfull 8 tbhits 0 time 11 pv b6b4 c3a4 b4d2 f3d2 c8b7 d2c4 h8h6 b2a3 
info depth 11 seldepth 12 multipv 1 score cp -40 wdl 3 920 77 nodes 25672 nps 1604500 hashfull 8 tbhits 0 time 16 pv b6b4 c3d5 f6d5 d2d5 c6e7 d5d2 b4d2 f3d2 f7f5 d2f3 h8h6 
info depth 12 seldepth 14 multipv 1 score cp -22 wdl 7 953 40 nodes 37775 nps 1642391 hashfull 12 tbhits 0 time 23 pv b6b4 f3g5 h8h6 c3e4 f6e4 g5e4 
info depth 13 seldepth 16 multipv 1 score mate 1 wdl 1000 0 0 nodes 71854 nps 1671023 hashfull 23 tbhits 0 time 43 pv b6f2 
info depth 14 seldepth 2 multipv 1 score mate 1 wdl 1000 0 0 nodes 71896 nps 1672000 hashfull 23 tbhits 0 time 43 pv b6f2 
info depth 15 seldepth 2 multipv 1 score mate 1 wdl 1000 0 0 nodes 71938 nps 1672976 hashfull 23 tbhits 0 time 43 pv b6f2 
info depth 16 seldepth 2 multipv 1 score mate 1 wdl 1000 0 0 nodes 71980 nps 1673953 hashfull 23 tbhits 0 time 43 pv b6f2 
info depth 17 seldepth 2 multipv 1 score mate 1 wdl 1000 0 0 nodes 72022 nps 1674930 hashfull 23 tbhits 0 time 43 pv b6f2 
info depth 18 seldepth 2 multipv 1 score mate 1 wdl 1000 0 0 nodes 72064 nps 1675906 hashfull 23 tbhits 0 time 43 pv b6f2 
...
position fen qnrbbnkr/p3pppp/3p4/1pp5/2P5/1P2P3/P2P1PPP/QNRBBNKR w KQkq - 0 4
go 
info string time -1 start 1699713657006 alloc 0 max 2147483647 depth 200 timeset 0 searchmoves 0
info depth 1 seldepth 1 multipv 1 score cp 16 wdl 56 922 22 nodes 59 nps 59000 hashfull 0 tbhits 0 time 1 pv h2h4 
info depth 2 seldepth 2 multipv 1 score cp 20 wdl 63 918 19 nodes 88 nps 88000 hashfull 0 tbhits 0 time 1 pv h2h4 b5c4 
info depth 3 seldepth 3 multipv 1 score cp 20 wdl 63 918 19 nodes 131 nps 131000 hashfull 0 tbhits 0 time 1 pv h2h4 b5c4 b3c4 
info depth 4 seldepth 4 multipv 1 score cp 23 wdl 69 914 17 nodes 196 nps 196000 hashfull 0 tbhits 0 time 1 pv b1c3 b5c4 b3c4 
info depth 5 seldepth 5 multipv 1 score cp 269 wdl 993 7 0 nodes 367 nps 367000 hashfull 0 tbhits 0 time 1 pv d1f3 
info depth 6 seldepth 5 multipv 1 score cp 450 wdl 1000 0 0 nodes 575 nps 575000 hashfull 0 tbhits 0 time 1 pv d1f3 
info depth 7 seldepth 7 multipv 1 score cp 46 wdl 129 862 9 nodes 1832 nps 1832000 hashfull 1 tbhits 0 time 1 pv d2d4 b5b4 d1f3 
info depth 8 seldepth 9 multipv 1 score cp -2 wdl 32 930 38 nodes 7523 nps 1880750 hashfull 2 tbhits 0 time 4 pv d1f3 e8c6 f3c6 a8c6 c4b5 c6b5 d2d4 h7h5 h2h3 
info depth 9 seldepth 12 multipv 1 score cp 5 wdl 41 929 30 nodes 8079 nps 2019750 hashfull 2 tbhits 0 time 4 pv d1f3 e8c6 f3c6 a8c6 c4b5 c6b5 h2h4 b5a6 d2d4 
info depth 10 seldepth 12 multipv 1 score cp 3 wdl 38 930 32 nodes 9005 nps 1801000 hashfull 2 tbhits 0 time 5 pv d1f3 e8c6 f3c6 a8c6 c4b5 c6b5 h2h4 b5b7 h4h5 b8c6 h5h6 
info depth 11 seldepth 14 multipv 1 score cp 18 wdl 59 921 20 nodes 10784 nps 1797333 hashfull 2 tbhits 0 time 6 pv d1f3 e8c6 f3c6 a8c6 c4b5 c6b5 h2h4 b5a6 
info depth 12 seldepth 15 multipv 1 score cp -5 wdl 29 930 41 nodes 36562 nps 2031222 hashfull 14 tbhits 0 time 18 pv d1f3 e8c6 f3c6 a8c6 c4b5 c6b5 h2h4 b5b7 h4h5 h7h6 d2d4 b8d7 d4c5 d7c5 b1c3 
info depth 13 seldepth 18 multipv 1 score cp 7 wdl 44 928 28 nodes 55233 nps 1972607 hashfull 21 tbhits 0 time 28 pv d2d4 b5c4 b3c4 e7e6 h2h4 e8c6 d4c5 c6g2 h1h2 d8f6 e1c3 f6c3 b1c3 g2f1 
info depth 14 seldepth 17 multipv 1 score cp 26 wdl 75 909 16 nodes 77319 nps 2034710 hashfull 28 tbhits 0 time 38 pv d2d4 b5c4 b3c4 e7e6 d4d5 e6d5 c4d5 a8d5 d1f3 d5f5 e1c3 e8c6 c3g7 c6f3 g7h8 
info depth 15 seldepth 21 multipv 1 score cp 26 wdl 75 909 16 nodes 155252 nps 2283117 hashfull 59 tbhits 0 time 68 pv d2d4 b5c4 b3c4 c5d4 e3d4 b8c6 f1e3 e7e5 d4d5 c6d4 e1c3 h7h5 c3d4 
info depth 16 seldepth 23 multipv 1 score cp 38 wdl 106 883 11 nodes 233131 nps 2403412 hashfull 83 tbhits 0 time 97 pv d2d4 b5c4 b3c4 c5d4 e3d4 h7h5 f1e3 b8c6 e1c3 e7e5 d4d5 c6e7 b1d2 d8b6 
info depth 17 seldepth 23 multipv 1 score cp 4 wdl 40 929 31 nodes 487931 nps 2476807 hashfull 185 tbhits 0 time 197 pv h2h4 e8c6 h4h5 e7e6 d2d4 d8f6 e1c3 c6g2 h1h2 g2f1 d4d5 f1c4 c3f6 g7f6 a1f6 
info depth 18 seldepth 25 multipv 1 score cp -13 wdl 23 925 52 nodes 851578 nps 2433080 hashfull 324 tbhits 0 time 350 pv h2h4 h7h5 f1g3 e8c6 h1h2 b5c4 b3c4 g7g6 d2d3 b8d7 e1c3 d7f6 g3f1 e7e5 b1d2 f8d7 
info depth 19 seldepth 21 multipv 1 score cp 4 wdl 40 929 31 nodes 1031664 nps 2427444 hashfull 384 tbhits 0 time 425 pv h2h4 e8c6 h4h5 h7h6 f2f3 b5b4 d2d4 e7e6 e1g3 d8e7 g3h4 e7g5 h4g5 h6g5 b1d2 
info depth 20 seldepth 28 multipv 1 score cp 11 wdl 48 927 25 nodes 1530341 nps 2383708 hashfull 546 tbhits 0 time 642 pv h2h4 e8c6 h4h5 h7h6 f2f3 b8d7 b1c3 b5b4 c3e2 e7e6 d2d4 a7a5 a1b1 a5a4 e1g3 d8e7 d1c2 f8h7 d4c5 
info depth 21 seldepth 27 multipv 1 score cp 52 wdl 153 840 7 nodes 2003014 nps 2401695 hashfull 666 tbhits 0 time 834 pv d2d4 b5b4 d1f3 e8c6 d4d5 c6b7 b1d2 b8d7 d2e4 a8b8 h2h3 e7e6 
info depth 22 seldepth 31 multipv 1 score cp 63 wdl 201 794 5 nodes 2586054 nps 2446597 hashfull 779 tbhits 0 time 1057 pv d1f3 e8c6 f3c6 b8c6 c4b5 c6e5 a1c3 h7h5 h2h3 e5g6 a2a4 a7a6 b5a6 g6h4 f2f3 f8g6 e1h4 g6h4 
info depth 23 seldepth 27 multipv 1 score mate 1 wdl 1000 0 0 nodes 2908493 nps 2464824 hashfull 828 tbhits 0 time 1180 pv a1g7 
info depth 24 seldepth 2 multipv 1 score mate 1 wdl 1000 0 0 nodes 2908523 nps 2464850 hashfull 828 tbhits 0 time 1180 pv a1g7 
info depth 25 seldepth 2 multipv 1 score mate 1 wdl 1000 0 0 nodes 2908553 nps 2464875 hashfull 828 tbhits 0 time 1180 pv a1g7 
info depth 26 seldepth 2 multipv 1 score mate 1 wdl 1000 0 0 nodes 2908583 nps 2464900 hashfull 828 tbhits 0 time 1180 pv a1g7 
...
position fen q4rkr/3nppp1/pP1b4/2p3Np/3n3P/BPQ5/P2P1PN1/1B2R1KR b Kkq - 0 16
go
info string time -1 start 1699713754000 alloc 0 max 2147483647 depth 200 timeset 0 searchmoves 0
info depth 1 seldepth 1 multipv 1 score cp -325 wdl 0 0 1000 nodes 8 nps 8000 hashfull 0 tbhits 0 time 1 pv a8c6 
info depth 2 seldepth 1 multipv 1 score cp -388 wdl 0 0 1000 nodes 25 nps 25000 hashfull 0 tbhits 0 time 1 pv e7e6 
info depth 3 seldepth 3 multipv 1 score cp -308 wdl 0 0 1000 nodes 49 nps 49000 hashfull 0 tbhits 0 time 1 pv e7e6 c3c4 h8h6 
info depth 4 seldepth 4 multipv 1 score cp -308 wdl 0 0 1000 nodes 71 nps 71000 hashfull 0 tbhits 0 time 1 pv e7e6 c3c4 h8h6 h1h3 
info depth 5 seldepth 5 multipv 1 score cp -341 wdl 0 0 1000 nodes 755 nps 755000 hashfull 0 tbhits 0 time 1 pv d4b5 c3c1 b5a3 c1a3 
info depth 6 seldepth 6 multipv 1 score mate 1 wdl 1000 0 0 nodes 1591 nps 1591000 hashfull 0 tbhits 0 time 1 pv a8g2 
info depth 7 seldepth 2 multipv 1 score mate 1 wdl 1000 0 0 nodes 1618 nps 1618000 hashfull 0 tbhits 0 time 1 pv a8g2 
info depth 8 seldepth 2 multipv 1 score mate 1 wdl 1000 0 0 nodes 1649 nps 1649000 hashfull 0 tbhits 0 time 1 pv a8g2 
info depth 9 seldepth 2 multipv 1 score mate 1 wdl 1000 0 0 nodes 1681 nps 1681000 hashfull 0 tbhits 0 time 1 pv a8g2 
info depth 10 seldepth 2 multipv 1 score mate 1 wdl 1000 0 0 nodes 1715 nps 1715000 hashfull 0 tbhits 0 time 1 pv a8g2 
info depth 11 seldepth 2 multipv 1 score mate 1 wdl 1000 0 0 nodes 1749 nps 1749000 hashfull 0 tbhits 0 time 1 pv a8g2 
info depth 12 seldepth 2 multipv 1 score mate 1 wdl 1000 0 0 nodes 1789 nps 1789000 hashfull 0 tbhits 0 time 1 pv a8g2 
...
jhonnold commented 8 months ago

Thanks again for spotting this - escaping perft made this a problematic bug and I know it's shown up at TCEC before in a game vs Scorpio IIRC.

jhonnold commented 8 months ago
Elo   | 22.81 +- 3.13 (95%)
Conf  | 10.0+0.10s Threads=1 Hash=8MB
Games | N: 20000 W: 4905 L: 3594 D: 11501
Penta | [143, 1761, 5150, 2534, 412]
http://chess.grantnet.us/test/34383/