search

LeelaChessZero / lc0

The rewritten engine, originally for tensorflow. Now all other backends have been ported here.
GNU General Public License v3.0
2.45k stars 531 forks source link

Sudden blundermove that loses the game - reproduced #674

Closed MelleKoning closed 4 years ago

MelleKoning commented 5 years ago

Found in the testgames of Ingo the following loss from network 32367 against stockfish10.

What surprises me most is the fact that the game is stalled for a very long time, both sides just shuffling their pieces around while nothing changes in the pawn-structure, until Lc0 suddenly chooses a blunder-move that loses the game.

Q: How come this blunder is suddenly occuring?

Game can be found on Lichess: https://lichess.org/3M9fwD1H#164

image

The blunder move played is 83.Bf4-h6, while lots of other moves would keep the draw (as all the earlier moves played already) How come move f4h6 is preferred? Does leela not see the counter-move from stockfish Rxd6+!!, while it apparently was aware of that counter move all the previous moves all along?

To reproduce:

C:\dev\lc0>lc0 --verbose-move-stats -t 1 --minibatch-size=1
       _
|   _ | |
|_ |_ |_| v0.20.1-rc1 built Jan  1 2019
position startpos moves e2e4 e7e6 b1c3 d7d5 d2d4 g8f6 e4e5 f6d7 f2f4 c7c5 g1f3 b8c6 c1e3 d8b6 c3a4 b6a5 c2c3 c5c4 b2b4 a5c7 f1e2 f8e7 e1g1 b7b5 a4c5 a7a5 a2a3 d7c5 d4c5 c8d7 d1d2 e8g8 f3d4 c6d4 e3d4 a5b4 a3b4 a8a4 a1d1 f8a8 e2f3 a4a2 d2e3 a8a6 e3e1 g7g6 h2h4 h7h5 e1g3 g8f8 d4f2 d7c6 f4f5 e6f5 g3f4 f8g8 f3d5 c6d5 d1d5 a2e2 f4d4 c7c6 d5d6 e7d6 e5d6 e2e4 d4d2 e4g4 g2g3 c6d7 d2d5 g4e4 f2d4 g8f8 d4e3 f8g7 f1f2 f7f6 e3f4 g7h8 f2d2 h8h7 g1f2 h7g7 f2f3 e4e8 d2c2 e8e1 c2f2 e1e6 f2d2 e6e1 d2f2 e1e8 f2d2 e8e6 f3f2 g7h7 f2f1 h7g7 d2d1 e6e8 d1d2 e8e4 f1f2 e4e8 d2b2 e8e6 b2d2 e6e8 d2c2 e8e4 f2g2 g7h8 g2f3 h8h7 c2g2 a6a3 g2c2 a3a6 c2f2 h7g7 f2b2 e4e8 b2g2 a6a3 g2c2 a3a6 c2b2 e8e4 b2h2 e4e6 h2c2 e6e7 c2b2 e7e8 b2g2 e8e7 g2c2 e7e6 c2d2 e6e4 d2g2 a6a3 g2c2 a3a6 c2d2 g7h7 d2e2 e4e2 f3e2 h7g7 e2e3 g7h7 e3f2 h7g7 f2e3 a6a3 e3d4 a3a1 d5f3 a1a6 f3h1 g7g8

go nodes 10000
Found pb network file: ./networks/1d69eb064bdac7716b76b0b093dc841054d5c8c0964cd92ef1fb7f6edd6276c9
Creating backend [cudnn]...
info depth 1 seldepth 2 time 118 nodes 2 score cp 223 hashfull 0 nps 16 tbhits 0 pv h1d5 g8g7
info depth 2 seldepth 3 time 173 nodes 3 score cp 209 hashfull 0 nps 17 tbhits 0 pv h1d5 g8g7 d5f3
info depth 2 seldepth 4 time 231 nodes 4 score cp 190 hashfull 0 nps 17 tbhits 0 pv h1d5 g8g7 d5f3 g7f7
info depth 2 seldepth 5 time 282 nodes 6 score cp 205 hashfull 0 nps 21 tbhits 0 pv h1d5 g8g7 d5f3 g7f7 f3e2
info depth 3 seldepth 6 time 335 nodes 7 score cp 159 hashfull 0 nps 20 tbhits 0 pv h1d5 g8g7 d5f3 g7f7 f3e2 d7b7
info depth 3 seldepth 6 time 488 nodes 16 score cp 191 hashfull 0 nps 32 tbhits 0 pv h1g2 g8g7 g2f3 g7f7 f3e2 d7b7
info depth 3 seldepth 6 time 543 nodes 20 score cp 234 hashfull 0 nps 36 tbhits 0 pv h1d5 g8g7 d5f3 g7f7 f3e2 d7b7
info depth 3 seldepth 7 time 571 nodes 24 score cp 154 hashfull 0 nps 42 tbhits 0 pv h1d5 g8g7 d5f3 g7f7 f3e2 d7b7 e2e3
info depth 3 seldepth 7 time 653 nodes 26 score cp 168 hashfull 0 nps 39 tbhits 0 pv h1g2 g8g7 g2f3 g7f7 f3e2 d7b7
info depth 3 seldepth 7 time 717 nodes 30 score cp 136 hashfull 0 nps 41 tbhits 0 pv h1d5 g8g7 d5f3 g7f7 f3e2 d7b7 e2e3
info depth 4 seldepth 7 time 780 nodes 32 score cp 136 hashfull 0 nps 41 tbhits 0 pv h1d5 g8g7 d5f3 g7f7 f3e2 d7b7 e2e3
info depth 4 seldepth 7 time 971 nodes 46 score cp 123 hashfull 0 nps 47 tbhits 0 pv h1g2 g8g7 g2f3 g7f7 f3e2 d7b7 e2e3
info depth 4 seldepth 7 time 977 nodes 47 score cp 133 hashfull 0 nps 48 tbhits 0 pv h1d5 g8g7 d5f3 g7f7 f3e2 d7b7 e2e3
info depth 4 seldepth 8 time 1542 nodes 129 score cp 172 hashfull 1 nps 83 tbhits 0 pv h1d5 g8g7 d5g2 g7h7 g2e2 h7g7 e2f3
info depth 4 seldepth 9 time 2382 nodes 243 score cp 193 hashfull 1 nps 102 tbhits 0 pv h1d5 g8g7 f4d2 g7h7 d5f3 h7g7 d2f4 g7h7
info depth 5 seldepth 9 time 2969 nodes 323 score cp 193 hashfull 2 nps 108 tbhits 0 pv h1d5 g8g7 f4d2 g7h7 d5f3 h7g7 d2f4 g7h7 f3e3
info depth 4 seldepth 9 time 2990 nodes 324 score cp 193 hashfull 2 nps 108 tbhits 0 pv h1d5 g8g7 f4d2 g7h7 d5f3 h7g7 d2f4 g7h7 f3e3
info depth 5 seldepth 9 time 3086 nodes 327 score cp 193 hashfull 2 nps 105 tbhits 0 pv h1d5 g8g7 f4d2 g7h7 d5f3 h7g7 d2f4 g7h7 f3e3
info depth 4 seldepth 9 time 3110 nodes 328 score cp 193 hashfull 2 nps 105 tbhits 0 pv h1d5 g8g7 f4d2 g7h7 d5f3 h7g7 d2f4 g7h7 f3e3
info depth 5 seldepth 9 time 3135 nodes 329 score cp 193 hashfull 2 nps 104 tbhits 0 pv h1d5 g8g7 f4d2 g7h7 d5f3 h7g7 d2f4 g7h7 f3e3
info depth 5 seldepth 10 time 3269 nodes 347 score cp 190 hashfull 2 nps 106 tbhits 0 pv h1d5 g8g7 f4d2 g7h7 d5f3 h7g7 d2f4 g7h7 f3e3
info depth 5 seldepth 10 time 5886 nodes 748 score cp 211 hashfull 4 nps 127 tbhits 0 pv f4d2 a6a2 d2f4 a2a6 h1f3 g8g7 f3e3 g7f7 e3f3 f7g7
info depth 5 seldepth 11 time 7785 nodes 993 score cp 205 hashfull 5 nps 127 tbhits 0 pv f4d2 g8h7 h1d5 h7g7 d2f4 g7h7 d5f3 h7g7 f3e2
info depth 6 seldepth 11 time 12369 nodes 1852 score cp 196 hashfull 8 nps 149 tbhits 0 pv f4d2 g8g7 h1d5 a6a2 d4e3 f5f4 g3f4 d7h3 e3e2 h3h2
info depth 5 seldepth 11 time 12380 nodes 1854 score cp 196 hashfull 8 nps 149 tbhits 0 pv f4d2 g8g7 h1d5 a6a2 d4e3 f5f4 g3f4 d7h3 e3e2 h3h2
info depth 6 seldepth 11 time 12435 nodes 1858 score cp 196 hashfull 8 nps 149 tbhits 0 pv f4d2 g8g7 h1d5 a6a2 d4e3 f5f4 g3f4 d7h3 e3e2 h3h2
info depth 6 seldepth 12 time 12705 nodes 1911 score cp 196 hashfull 9 nps 150 tbhits 0 pv f4d2 g8g7 h1d5 a6a2 d4e3 f5f4 g3f4 d7h3 e3e2 h3h2
info depth 6 seldepth 12 time 17718 nodes 2696 score cp 185 hashfull 12 nps 152 tbhits 0 pv f4d2 g8g7 h1d5 a6a2 d2f4 a2a6 d5f3 g7h7 f3e3 h7g7 e3e2
info depth 6 seldepth 13 time 19210 nodes 2947 score cp 190 hashfull 13 nps 153 tbhits 0 pv f4d2 g8g7 h1d5 a6a2 d2f4 a2a6 d5f3 g7h7 f3e3 h7g7 e3e2
info depth 6 seldepth 14 time 19267 nodes 2948 score cp 190 hashfull 13 nps 153 tbhits 0 pv f4d2 g8g7 h1d5 a6a2 d2f4 a2a6 d5f3 g7h7 f3e3 h7g7 e3e2
info depth 6 seldepth 15 time 19336 nodes 2955 score cp 190 hashfull 13 nps 152 tbhits 0 pv f4d2 g8g7 h1d5 a6a2 d2f4 a2a6 d5f3 g7h7 f3e3 h7g7 e3e2
info depth 6 seldepth 16 time 19603 nodes 3016 score cp 192 hashfull 13 nps 153 tbhits 0 pv f4d2 g8g7 h1d5 a6a2 d2f4 a2a6 d5f3 g7h7 f3e3 h7g7 e3e2
info depth 6 seldepth 17 time 19619 nodes 3017 score cp 192 hashfull 13 nps 153 tbhits 0 pv f4d2 g8g7 h1d5 a6a2 d2f4 a2a6 d5f3 g7h7 f3e3 h7g7 e3e2
info depth 6 seldepth 17 time 24626 nodes 4020 score cp 183 hashfull 16 nps 163 tbhits 0 pv f4d2 g8g7 d2e3 d7a7 h1d5 a6a1 d5f3 a1a6 e3f4 a6a1 f3e2
info depth 6 seldepth 17 time 29649 nodes 5107 score cp 175 hashfull 19 nps 172 tbhits 0 pv f4d2 g8g7 d2e3 d7a7 h1d5 a6a1 d5f3 a1a6 e3f4 a6a1 f3e2 a1a2 e2e8
info depth 6 seldepth 18 time 33575 nodes 6008 score cp 165 hashfull 21 nps 178 tbhits 0 pv f4d2 g8g7 d2e3 d7a7 h1d5 a6a1 d5f3 a1a6 e3f4 a6a1 f3e2 a1a2 e2e8
info depth 7 seldepth 18 time 34364 nodes 6121 score cp 165 hashfull 22 nps 178 tbhits 0 pv f4d2 g8g7 d2e3 d7e8 h1b7 g7g8 e3f4 a6a1 b7d5 g8g7 c5c6 a1d1 d4c5
info depth 7 seldepth 18 time 39377 nodes 7213 score cp 160 hashfull 25 nps 183 tbhits 0 pv f4d2 g8g7 d2e3 g7h7 e3f4 h7h8 h1f3 h8g7 f3e2 g7f7 e2g2 f7g7
info depth 7 seldepth 18 time 44385 nodes 8571 score cp 159 hashfull 27 nps 193 tbhits 0 pv f4d2 g8g7 d2e3 g7h7 e3f4 h7h8 h1f3 h8g7 f3e2 g7f7 e2g2 f7g7
info depth 7 seldepth 18 time 49410 nodes 8971 score cp 159 hashfull 28 nps 181 tbhits 0 pv f4d2 g8g7 d2e3 g7h7 e3f4 h7h8 h1f3 h8g7 f3e2 g7f7 e2g2 f7g7
info depth 7 seldepth 18 time 49424 nodes 8981 score cp 162 hashfull 28 nps 181 tbhits 0 pv f4h6 g8h7 h6f4 h7g8 h1d5 g8g7 f4d2 g7h7 d4e3 h7g7 e3f2 g7h7 f2e2
info depth 7 seldepth 18 time 54462 nodes 9276 score cp 161 hashfull 28 nps 170 tbhits 0 pv f4h6 g8h7 h6f4 h7g8 h1d5 g8g7 f4d2 g7h7 d4e3 h7g7 e3f2 g7h7 f2e2
info depth 7 seldepth 18 time 56694 nodes 9507 score cp 159 hashfull 29 nps 167 tbhits 0 pv f4h6 g8h7 h6f4 h7g7 h1d5 g7h7 f4d2 h7g7 d5f3 g7h7 d2f4 h7g7 f3e2
info string h1a1  (171 ) N:       2 (+ 0) (P:  0.99%) (Q: -0.98044) (U: 1.21814) (Q+U:  0.23770) (V: -0.9687)
info string h1h3  (183 ) N:       2 (+ 0) (P:  0.96%) (Q: -0.70263) (U: 1.18432) (Q+U:  0.48168) (V: -0.6681)
info string f4e5  (829 ) N:       3 (+ 0) (P:  0.80%) (Q: -0.62422) (U: 0.74343) (Q+U:  0.11920) (V: -0.3954)
info string h1b7  (190 ) N:       3 (+ 0) (P:  1.63%) (Q: -0.97234) (U: 1.50306) (Q+U:  0.53073) (V: -0.9314)
info string f4g5  (831 ) N:       4 (+ 0) (P:  1.01%) (Q: -0.54140) (U: 0.74526) (Q+U:  0.20386) (V: -0.3146)
info string h1a8  (192 ) N:       4 (+ 0) (P:  1.67%) (Q: -0.92401) (U: 1.23346) (Q+U:  0.30945) (V: -0.7450)
info string h1c6  (188 ) N:       4 (+ 0) (P:  1.77%) (Q: -0.99228) (U: 1.31012) (Q+U:  0.31785) (V: -0.9807)
info string h1e4  (184 ) N:       6 (+ 0) (P:  2.53%) (Q: -0.95528) (U: 1.33324) (Q+U:  0.37796) (V: -0.7713)
info string g3g4  (615 ) N:      12 (+ 0) (P:  1.43%) (Q: -0.03528) (U: 0.40567) (Q+U:  0.37040) (V:  0.2680)
info string h1h2  (180 ) N:      12 (+ 0) (P:  1.73%) (Q: -0.09416) (U: 0.49175) (Q+U:  0.39759) (V: -0.3187)
info string h1g1  (177 ) N:      17 (+ 0) (P:  1.94%) (Q: -0.03912) (U: 0.39853) (Q+U:  0.35941) (V: -0.3212)
info string d4d5  (761 ) N:      18 (+ 0) (P:  5.33%) (Q: -0.57002) (U: 1.03550) (Q+U:  0.46547) (V: -0.3646)
info string h1d1  (174 ) N:      25 (+ 0) (P:  2.70%) (Q: -0.02559) (U: 0.38323) (Q+U:  0.35765) (V:  0.0416)
info string c5c6  (973 ) N:      27 (+ 0) (P:  5.75%) (Q: -0.35640) (U: 0.75883) (Q+U:  0.40243) (V:  0.3932)
info string h1f1  (176 ) N:      31 (+ 0) (P:  3.27%) (Q:  0.00043) (U: 0.37700) (Q+U:  0.37743) (V: -0.0702)
info string h1c1  (173 ) N:      38 (+ 0) (P:  4.14%) (Q: -0.00881) (U: 0.39201) (Q+U:  0.38320) (V: -0.1290)
info string h1b1  (172 ) N:      57 (+ 0) (P:  7.10%) (Q: -0.06837) (U: 0.45196) (Q+U:  0.38359) (V: -0.0939)
info string d4e3  (750 ) N:      85 (+ 0) (P:  1.81%) (Q:  0.26281) (U: 0.07787) (Q+U:  0.34069) (V: -0.0728)
info string f4c1  (809 ) N:     131 (+ 0) (P:  1.37%) (Q:  0.29439) (U: 0.03843) (Q+U:  0.33282) (V:  0.2624)
info string h1g2  (179 ) N:     428 (+ 0) (P: 10.29%) (Q:  0.25227) (U: 0.08859) (Q+U:  0.34087) (V:  0.5788)
info string h1f3  (181 ) N:     500 (+ 0) (P: 10.63%) (Q:  0.25966) (U: 0.07836) (Q+U:  0.33802) (V:  0.2481)
info string h1e1  (175 ) N:     526 (+ 0) (P: 10.98%) (Q:  0.25919) (U: 0.07700) (Q+U:  0.33619) (V:  0.0796)
info string h1d5  (186 ) N:    1164 (+ 0) (P: 12.30%) (Q:  0.29300) (U: 0.03901) (Q+U:  0.33202) (V:  0.4232)
info string f4e3  (817 ) N:    1549 (+ 0) (P:  2.64%) (Q:  0.32318) (U: 0.00628) (Q+U:  0.32946) (V:  0.1320)
info string f4d2  (811 ) N:    2182 (+ 0) (P:  2.68%) (Q:  0.32328) (U: 0.00454) (Q+U:  0.32782) (V:  0.3784)
info string f4h6  (837 ) N:    2676 (+ 1) (P:  2.57%) (Q:  0.32469) (U: 0.00354) (Q+U:  0.32823) (V:  0.3273)
bestmove f4h6 ponder g8h7
MelleKoning commented 5 years ago

Another example from another lost game from the same test from Ingo: See move 118.Rf2 in this game, which looks like a total draw for over 50 moves before until leela decides to go into a wrong direction on move 118: https://lichess.org/lZPrcLkU#235

MelleKoning commented 5 years ago

Another net from test40, 40110 also gives a blunder move. This time not after 10k but after 20k nodes.

go nodes 20000
info depth 6 seldepth 6 time 2 nodes 8837 score cp 207 hashfull 31 nps 500 tbhits 0 pv h1d5 g8g7 f4c1 g7h7 c1f4 h7g7 c5c6 a6c6 d5b5 g7f7 b5d5 f7g7 b4b5 c6c8 b5b6
info depth 4 seldepth 6 time 16 nodes 8838 score cp 207 hashfull 31 nps 125 tbhits 0 pv h1d5 g8g7 f4c1 g7h7 c1f4 h7g7 c5c6 a6c6 d5b5 g7f7 b5d5 f7g7 b4b5 c6c8 b5b6
info depth 5 seldepth 7 time 83 nodes 8839 score cp 207 hashfull 31 nps 36 tbhits 0 pv h1d5 g8g7 f4c1 g7h7 c1f4 h7g7 c5c6 a6c6 d5b5 g7f7 b5d5 f7g7 b4b5 c6c8 b5b6
info depth 4 seldepth 7 time 96 nodes 8841 score cp 207 hashfull 31 nps 52 tbhits 0 pv h1d5 g8g7 f4c1 g7h7 c1f4 h7g7 c5c6 a6c6 d5b5 g7f7 b5d5 f7g7 b4b5 c6c8 b5b6
info depth 5 seldepth 7 time 107 nodes 8844 score cp 207 hashfull 31 nps 74 tbhits 0 pv h1d5 g8g7 f4c1 g7h7 c1f4 h7g7 c5c6 a6c6 d5b5 g7f7 b5d5 f7g7 b4b5 c6c8 b5b6
info depth 5 seldepth 9 time 121 nodes 8850 score cp 207 hashfull 31 nps 115 tbhits 0 pv h1d5 g8g7 f4c1 g7h7 c1f4 h7g7 c5c6 a6c6 d5b5 g7f7 b5d5 f7g7 b4b5 c6c8 b5b6
info depth 6 seldepth 9 time 287 nodes 8874 score cp 207 hashfull 31 nps 132 tbhits 0 pv h1d5 g8g7 f4c1 g7h7 c1f4 h7g7 c5c6 a6c6 d5b5 g7f7 b5d5 f7g7 b4b5 c6c8 b5b6
info depth 6 seldepth 10 time 532 nodes 8923 score cp 207 hashfull 31 nps 163 tbhits 0 pv h1d5 g8g7 f4c1 g7h7 c1f4 h7g7 c5c6 a6c6 d5b5 g7f7 b5d5 f7g7 b4b5 c6c8 b5b6
info depth 6 seldepth 11 time 540 nodes 8927 score cp 207 hashfull 31 nps 168 tbhits 0 pv h1d5 g8g7 f4c1 g7h7 c1f4 h7g7 c5c6 a6c6 d5b5 g7f7 b5d5 f7g7 b4b5 c6c8 b5b6
info depth 6 seldepth 12 time 593 nodes 8928 score cp 207 hashfull 31 nps 155 tbhits 0 pv h1d5 g8g7 f4c1 g7h7 c1f4 h7g7 c5c6 a6c6 d5b5 g7f7 b5d5 f7g7 b4b5 c6c8 b5b6
info depth 6 seldepth 13 time 646 nodes 8935 score cp 207 hashfull 31 nps 153 tbhits 0 pv h1d5 g8g7 f4c1 g7h7 c1f4 h7g7 c5c6 a6c6 d5b5 g7f7 b5d5 f7g7 b4b5 c6c8 b5b6
info depth 7 seldepth 13 time 654 nodes 8948 score cp 207 hashfull 31 nps 171 tbhits 0 pv h1d5 g8g7 f4c1 g7h7 c1f4 h7g7 c5c6 a6c6 d5b5 g7f7 b5d5 f7g7 b4b5 c6c8 b5b6
info depth 7 seldepth 14 time 1024 nodes 9001 score cp 207 hashfull 32 nps 161 tbhits 0 pv h1d5 g8g7 f4c1 g7h7 c1f4 h7g7 c5c6 a6c6 d5b5 g7f7 b5d5 f7g7 b4b5 c6c8 b5b6
info depth 7 seldepth 15 time 2240 nodes 9149 score cp 207 hashfull 32 nps 139 tbhits 0 pv h1d5 g8g7 f4c1 g7h7 c1f4 h7g7 c5c6 a6c6 d5b5 g7f7 b5d5 f7g7 b4b5 c6c8 b5b6
info depth 7 seldepth 15 time 7264 nodes 10385 score cp 203 hashfull 35 nps 213 tbhits 0 pv h1d5 g8g7 f4c1 g7h7 c1f4 h7g7 c5c6 a6c6 d5b5 g7f7 b5d5 f7g7 b4b5 c6c8 b5b6
info depth 7 seldepth 16 time 8080 nodes 10530 score cp 205 hashfull 36 nps 209 tbhits 0 pv h1d5 g8g7 f4c1 g7h7 c1f4 h7g7 f4e3 g7h7 e3c1 h7g7 c1f4 g7h7 d5f3 h7g7 f3d5
info depth 7 seldepth 17 time 9340 nodes 10809 score cp 206 hashfull 36 nps 211 tbhits 0 pv h1d5 g8g7 f4c1 g7h7 c1f4 h7g7 f4e3 g7h7 e3c1 h7g7 c1f4 g7h7 d5f3 h7g7 f3d5
info depth 8 seldepth 17 time 9488 nodes 10865 score cp 206 hashfull 36 nps 213 tbhits 0 pv h1d5 g8g7 f4c1 g7h7 c1f4 h7g7 f4e3 g7h7 e3c1 h7g7 c1f4 g7h7 d5f3 h7g7 f3d5
info depth 8 seldepth 17 time 14512 nodes 11567 score cp 205 hashfull 40 nps 188 tbhits 0 pv h1d5 g8g7 f4c1 g7h7 c1f4 h7g7 f4e3 g7h7 e3c1 h7g7 c1f4 g7h7 d5f3 h7g7 f3d5
info depth 8 seldepth 17 time 19514 nodes 12473 score cp 204 hashfull 43 nps 186 tbhits 0 pv h1d5 g8g7 f4c1 g7h7 c1f4 h7g7 f4e3 g7h7 e3c1 h7g7 c1f4 g7h7 d5f3 h7g7 f3d5
info depth 7 seldepth 17 time 23696 nodes 13307 score cp 201 hashfull 45 nps 188 tbhits 0 pv h1d5 g8g7 f4c1 g7h7 c1f4 h7g7 f4e3 g7h7 e3c1 h7g7 c1f4 g7h7 d5f3 h7g7 f3d5
info depth 7 seldepth 17 time 28725 nodes 14661 score cp 201 hashfull 48 nps 202 tbhits 0 pv h1d5 g8g7 f4c1 g7h7 c1f4 h7g7 f4e3 g7h7 e3c1 h7g7 c1f4 g7h7 d5f3 h7g7 f3d5
info depth 7 seldepth 17 time 33752 nodes 16105 score cp 201 hashfull 50 nps 215 tbhits 0 pv h1d5 g8g7 f4c1 g7h7 c1f4 h7g7 f4e3 g7h7 e3c1 h7g7 c1f4 g7h7 d5f3 h7g7 f3d5
info depth 7 seldepth 17 time 38767 nodes 17174 score cp 201 hashfull 52 nps 215 tbhits 0 pv h1d5 g8g7 f4c1 g7h7 c1f4 h7g7 f4e3 g7h7 e3c1 h7g7 c1f4 g7h7 d5f3 h7g7 f3d5
info depth 7 seldepth 17 time 39434 nodes 17284 score cp 220 hashfull 52 nps 214 tbhits 0 pv f4c1 g8g7 h1d5 a6c6 c1f4 g7h7 d4e3 h7g7 e3d2 g7h7 d2e2 h7g7
info depth 7 seldepth 17 time 44462 nodes 17840 score cp 217 hashfull 52 nps 202 tbhits 0 pv f4c1 g8h7 h1d5 h7g7 c1f4 g7h7 d5f3 h7g7 f3d5 g7h7 d4e3 h7g7 e3f2 g7h7 f2f3
info depth 7 seldepth 17 time 49472 nodes 18326 score cp 216 hashfull 53 nps 191 tbhits 0 pv f4c1 g8h7 h1d5 h7g7 c1f4 g7h7 d5f3 h7g7 f3d5 g7h7 d4e3 h7g7 e3f2 g7h7 f2f3
info depth 7 seldepth 17 time 51919 nodes 18644 score cp 216 hashfull 53 nps 188 tbhits 0 pv f4c1 g8h7 h1d5 h7g7 c1d2 g7h7 d2f4 h7g7 c5c6 a6c6 d5b5 g7f7 b5d5 f7g7 b4b5
info string h1a1  (171 ) N:       6 (+ 0) (P:  1.67%) (Q: -0.89682) (U: 1.41453) (Q+U:  0.51771) (V: -0.4852)
info string f4e5  (829 ) N:       7 (+ 0) (P:  0.83%) (Q: -0.14328) (U: 0.61293) (Q+U:  0.46964) (V: -0.3229)
info string f4g5  (831 ) N:       8 (+ 0) (P:  0.79%) (Q: -0.07812) (U: 0.51846) (Q+U:  0.44034) (V: -0.0435)
info string h1a8  (192 ) N:       9 (+ 0) (P:  2.19%) (Q: -0.82761) (U: 1.29703) (Q+U:  0.46942) (V:  0.2662)
info string h1c6  (188 ) N:       9 (+ 0) (P:  2.34%) (Q: -0.86421) (U: 1.38425) (Q+U:  0.52004) (V: -0.1015)
info string h1e4  (184 ) N:      10 (+ 0) (P:  2.61%) (Q: -0.90933) (U: 1.40673) (Q+U:  0.49740) (V: -0.3522)
info string h1b7  (190 ) N:      10 (+ 0) (P:  2.52%) (Q: -0.82284) (U: 1.35907) (Q+U:  0.53623) (V:  0.3690)
info string g3g4  (615 ) N:      18 (+ 0) (P:  1.08%) (Q:  0.09576) (U: 0.33704) (Q+U:  0.43280) (V:  0.1677)
info string h1h3  (183 ) N:      22 (+ 0) (P:  1.39%) (Q:  0.10933) (U: 0.35781) (Q+U:  0.46714) (V: -0.1393)
info string d4d5  (761 ) N:      43 (+ 0) (P:  8.00%) (Q: -0.54412) (U: 1.07682) (Q+U:  0.53270) (V:  0.1988)
info string h1h2  (180 ) N:      59 (+ 0) (P:  2.47%) (Q:  0.20118) (U: 0.24381) (Q+U:  0.44499) (V: -0.0315)
info string h1c1  (173 ) N:      61 (+ 0) (P:  4.43%) (Q:  0.05528) (U: 0.42350) (Q+U:  0.47878) (V:  0.0142)
info string h1f1  (176 ) N:      62 (+ 0) (P:  2.99%) (Q:  0.17796) (U: 0.28084) (Q+U:  0.45880) (V:  0.0650)
info string h1g1  (177 ) N:      62 (+ 0) (P:  3.83%) (Q:  0.10973) (U: 0.35968) (Q+U:  0.46941) (V:  0.0440)
info string h1b1  (172 ) N:      62 (+ 0) (P:  3.92%) (Q:  0.10389) (U: 0.36814) (Q+U:  0.47203) (V:  0.0767)
info string h1d1  (174 ) N:      76 (+ 0) (P:  4.84%) (Q:  0.09964) (U: 0.37211) (Q+U:  0.47175) (V:  0.1567)
info string c5c6  (973 ) N:      85 (+ 0) (P:  2.87%) (Q:  0.24485) (U: 0.19748) (Q+U:  0.44233) (V:  0.3303)
info string d4e3  (750 ) N:     179 (+ 0) (P:  3.11%) (Q:  0.32429) (U: 0.10249) (Q+U:  0.42677) (V:  0.2531)
info string h1e1  (175 ) N:     526 (+ 0) (P:  9.16%) (Q:  0.32405) (U: 0.10301) (Q+U:  0.42706) (V:  0.5120)
info string f4e3  (817 ) N:     864 (+ 0) (P:  2.67%) (Q:  0.39004) (U: 0.01828) (Q+U:  0.40832) (V:  0.2430)
info string h1g2  (179 ) N:    1267 (+ 0) (P:  8.11%) (Q:  0.37566) (U: 0.03788) (Q+U:  0.41354) (V:  0.3393)
info string f4h6  (837 ) N:    1623 (+ 0) (P:  2.38%) (Q:  0.39871) (U: 0.00870) (Q+U:  0.40741) (V:  0.3415)
info string h1f3  (181 ) N:    1771 (+ 0) (P:  8.86%) (Q:  0.38212) (U: 0.02963) (Q+U:  0.41175) (V:  0.4051)
info string f4d2  (811 ) N:    1838 (+ 0) (P:  1.74%) (Q:  0.40046) (U: 0.00559) (Q+U:  0.40605) (V:  0.2403)
info string h1d5  (186 ) N:    4303 (+ 0) (P: 13.04%) (Q:  0.39129) (U: 0.01794) (Q+U:  0.40923) (V:  0.5185)
info string f4c1  (809 ) N:    5663 (+ 0) (P:  2.18%) (Q:  0.41320) (U: 0.00228) (Q+U:  0.41548) (V:  0.2134)
bestmove f4c1 ponder g8h7

The move Bf4-c1 is also a blunder move while Qh1-d5 which is found before is the move that would hold the draw. Suspect therefore that this is not a net issue, but some search- or cutoff issue for game-end although I would not know how to prove that.

Videodr0me commented 5 years ago

Try this version with Certainty Propagation enabled: https://ci.appveyor.com/project/LeelaChessZero/lc0/builds/21908253/job/92pkh2tvbq9ffihg/artifacts

Or the stronger version with look-ahead here, but you might need to increase threads to ( 2 * no. of gpus) +1: https://ci.appveyor.com/project/LeelaChessZero/lc0/builds/21916156/job/851awkkkw5etj92n/artifacts

both are the cuda versions, but others are available too. These versions might help in some of your positions.

Naphthalin commented 4 years ago

Occasional blind spots and blunders are to be expected from the nature of search and training; the frequency has dropped significantly though, so this isn't a real issue anymore. Issue can be closed.

MelleKoning commented 4 years ago

Closing issue