search

CuriosAI / sai

SAI: a fork of Leela Zero with variable komi.
GNU General Public License v3.0
105 stars 11 forks source link

sai79 v400 vs lz250 v1 #47

Open l1t1 opened 4 years ago

l1t1 commented 4 years ago
net games win
77 48 11
80 36 5
82 74 24
83 38 6
86 45 9
87 46 10
89 36 5
101 54 14
102 91 33
104 77 26
105 66 20
107 46 10
108 70 22
110 41 7
111 95 35
113 56 15
114 70 22
119 74 24
120 102 39
121 77 26
122 83 29
124 68 21
125 36 5
126 54 14
127 72 23
129 131 54
139 278 131
165 108 42
166 236 109
169 466 230

validation -k sai77_lz250 -n af4.gz -o "-g -v 400 -r 5 -w" -n networks/3d415846183a7f51a40aaa80a007d886668e759c37be8712febf09ec2823d257.gz -o "-g -v 1 -r 5 -w" -- sai -- sai

11 wins, 37 losses
The first net is worse than the second
af4.gz   v networks ( 48 games)
              wins        black       white
af4.gz     11 22.92%    5 21.74%    6 24.00%
networks   37 77.08%   18 78.26%   19 76.00%
                       23 47.92%   25 52.08%
l1t1 commented 4 years ago

validation -k sai80_lz250 -n 800.gz -o "-g -v 400 -r 5 -w" -n networks/3d415846183a7f51a40aaa80a007d886668e759c37be8712febf09ec2823d257.gz -o "-g -v 1 -r 5 -w" -- sai -- sai

5 wins, 31 losses
The first net is worse than the second
800.gz   v networks ( 36 games)
              wins        black       white
800.gz      5 13.89%    3 15.79%    2 11.76%
networks   31 86.11%   16 84.21%   15 88.24%
                       19 52.78%   17 47.22%
l1t1 commented 4 years ago

validation -k sai82_lz250 -n 8ee.gz -o "-g -v 400 -r 5 -w" -n networks/3d415846183a7f51a40aaa80a007d886668e759c37be8712febf09ec2823d257.gz -o "-g -v 1 -r 5 -w" -- sai -- sai

24 wins, 50 losses
The first net is worse than the second
8ee.gz   v networks ( 74 games)
              wins        black       white
8ee.gz     24 32.43%   12 32.43%   12 32.43%
networks   50 67.57%   25 67.57%   25 67.57%
                       37 50.00%   37 50.00%
l1t1 commented 4 years ago

validation -k sai83_lz250 -n b1f.gz -o "-g -v 400 -r 5 -w" -n networks/3d415846183a7f51a40aaa80a007d886668e759c37be8712febf09ec2823d257.gz -o "-g -v 1 -r 5 -w" -- sai -- sai

6 wins, 32 losses
The first net is worse than the second
b1f.gz   v networks ( 38 games)
              wins        black       white
b1f.gz      6 15.79%    3 16.67%    3 15.00%
networks   32 84.21%   15 83.33%   17 85.00%
                       18 47.37%   20 52.63%
l1t1 commented 4 years ago

validation -k sai86_lz250 -n ea1.gz -o "-g -v 400 -r 5 -w" -n networks/3d415846183a7f51a40aaa80a007d886668e759c37be8712febf09ec2823d257.gz -o "-g -v 1 -r 5 -w" -- sai -- sai

9 wins, 36 losses
The first net is worse than the second
ea1.gz   v networks ( 45 games)
              wins        black       white
ea1.gz      9 20.00%    6 24.00%    3 15.00%
networks   36 80.00%   19 76.00%   17 85.00%
                       25 55.56%   20 44.44%
l1t1 commented 4 years ago

validation -k sai87_lz250 -n c3c.gz -o "-g -v 400 -r 5 -w" -n networks/3d415846183a7f51a40aaa80a007d886668e759c37be8712febf09ec2823d257.gz -o "-g -v 1 -r 5 -w" -- sai -- sai

10 wins, 36 losses
The first net is worse than the second
c3c.gz   v networks ( 46 games)
              wins        black       white
c3c.gz     10 21.74%    5 21.74%    5 21.74%
networks   36 78.26%   18 78.26%   18 78.26%
                       23 50.00%   23 50.00%
l1t1 commented 4 years ago

validation -g 2 -k sai89_lz250 -n b85.gz -o "-g -v 400 -r 5 -w" -n networks/3d415846183a7f51a40aaa80a007d886668e759c37be8712febf09ec2823d257.gz -o "-g -v 1 -r 5 -w" -- sai -- sai

5 wins, 31 losses
The first net is worse than the second
b85.gz   v networks ( 36 games)
              wins        black       white
b85.gz      5 13.89%    2 12.50%    3 15.00%
networks   31 86.11%   14 87.50%   17 85.00%
                       16 44.44%   20 55.56%
l1t1 commented 4 years ago

validation -g 2 -k sai90_lz251 -n cc3.gz -o "-g -v 400 -r 5 -w" -n networks/b346eff6bd20d5e9e2229549916c323a9f3b42e60ecd0a4e16903f4a6967a069.gz -o "-g -v 1 -r 5 -w" -- sai -- sai

4 wins, 30 losses
The first net is worse than the second
cc3.gz   v networks ( 34 games)
              wins        black       white
cc3.gz      4 11.76%    1  6.67%    3 15.79%
networks   30 88.24%   14 93.33%   16 84.21%
                       15 44.12%   19 55.88%
l1t1 commented 4 years ago

validation -g 1 -k sai90_lz250 -n cc3.gz -o "-g -v 400 -r 5 -w" -n networks/3d415846183a7f51a40aaa80a007d886668e759c37be8712febf09ec2823d257.gz -o "-g -v 1 -r 5 -w" -- sai -- sai

8 wins, 22 losses
30 games played.
Status: 0 LLR -1.63209 Lower Bound -2.94444 Upper Bound 2.94444
l1t1 commented 4 years ago

the test is comparable with https://github.com/sai-dev/sai/issues/44#issuecomment-554627784

l1t1 commented 4 years ago

validation -g 2 -k sai101_lz250 -n 438.gz -o "-g -v 400 -r 5 -w" -n networks/3d415846183a7f51a40aaa80a007d886668e759c37be8712febf09ec2823d257.gz -o "-g -v 1 -r 5 -w" -- sai -- sai

14 wins, 40 losses
The first net is worse than the second
438.gz   v networks ( 54 games)
              wins        black       white
438.gz     14 25.93%    7 25.93%    7 25.93%
networks   40 74.07%   20 74.07%   20 74.07%
                       27 50.00%   27 50.00%
l1t1 commented 4 years ago

validation -g 1 -k sai102_lz250 -n b23.gz -o "-g -v 400 -r 5 -w" -n networks/3d415846183a7f51a40aaa80a007d886668e759c37be8712febf09ec2823d257.gz -o "-g -v 1 -r 5 -w" -- sai -- sai

33 wins, 58 losses
The first net is worse than the second
b23.gz   v networks ( 91 games)
              wins        black       white
b23.gz     33 36.26%   13 34.21%   20 37.74%
networks   58 63.74%   25 65.79%   33 62.26%
                       38 41.76%   53 58.24%
l1t1 commented 4 years ago

validation -g 1 -k sai104_lz250 -n 6fd.gz -o "-g -v 400 -r 5 -w" -n networks/3d415846183a7f51a40aaa80a007d886668e759c37be8712febf09ec2823d257.gz -o "-g -v 1 -r 5 -w" -- sai -- sai

26 wins, 51 losses
The first net is worse than the second
6fd.gz   v networks ( 77 games)
              wins        black       white
6fd.gz     26 33.77%   14 35.00%   12 32.43%
networks   51 66.23%   26 65.00%   25 67.57%
                       40 51.95%   37 48.05%
l1t1 commented 4 years ago

validation -g 1 -k sai105_lz250 -n 9de.gz -o "-g -v 400 -r 5 -w" -n networks/3d415846183a7f51a40aaa80a007d886668e759c37be8712febf09ec2823d257.gz -o "-g -v 1 -r 5 -w" -- sai -- sai

20 wins, 46 losses
The first net is worse than the second
9de.gz   v networks ( 66 games)
              wins        black       white
9de.gz     20 30.30%    9 29.03%   11 31.43%
networks   46 69.70%   22 70.97%   24 68.57%
                       31 46.97%   35 53.03%
l1t1 commented 4 years ago

validation -g 1 -k sai106_lz250 -n 654.gz -o "-g -v 400 -r 5 -w" -n networks/3d415846183a7f51a40aaa80a007d886668e759c37be8712febf09ec2823d257.gz -o "-g -v 1 -r 5 -w" -- sai -- sai

10 wins, 36 losses
The first net is worse than the second
654.gz   v networks ( 46 games)
              wins        black       white
654.gz     10 21.74%    8 27.59%    2 11.76%
networks   36 78.26%   21 72.41%   15 88.24%
                       29 63.04%   17 36.96%
l1t1 commented 4 years ago

validation -g 1 -k sai108_lz250 -n 09b.gz -o "-g -v 400 -r 5 -w" -n networks/3d415846183a7f51a40aaa80a007d886668e759c37be8712febf09ec2823d257.gz -o "-g -v 1 -r 5 -w" -- sai -- sai

22 wins, 48 losses
The first net is worse than the second
09b.gz   v networks ( 70 games)
              wins        black       white
09b.gz     22 31.43%   10 30.30%   12 32.43%
networks   48 68.57%   23 69.70%   25 67.57%
                       33 47.14%   37 52.86%
l1t1 commented 4 years ago

validation -g 1 -k sai110_lz250 -n bfd.gz -o "-g -v 400 -r 5 -w" -n networks/3d415846183a7f51a40aaa80a007d886668e759c37be8712febf09ec2823d257.gz -o "-g -v 1 -r 5 -w" -- sai -- sai

7 wins, 34 losses
The first net is worse than the second
bfd.gz   v networks ( 41 games)
              wins        black       white
bfd.gz      7 17.07%    4 19.05%    3 15.00%
networks   34 82.93%   17 80.95%   17 85.00%
                       21 51.22%   20 48.78%
l1t1 commented 4 years ago

validation -g 1 -k sai111_lz250 -n 78d.gz -o "-g -v 400 -r 5 -w" -n networks/3d415846183a7f51a40aaa80a007d886668e759c37be8712febf09ec2823d257.gz -o "-g -v 1 -r 5 -w" -- sai -- sai

35 wins, 60 losses
The first net is worse than the second
78d.gz   v networks ( 95 games)
              wins        black       white
78d.gz     35 36.84%   15 35.71%   20 37.74%
networks   60 63.16%   27 64.29%   33 62.26%
                       42 44.21%   53 55.79%
l1t1 commented 4 years ago

validation -g 1 -k sai113_lz250 -n 264.gz -o "-g -v 400 -r 5 -w" -n networks/3d415846183a7f51a40aaa80a007d886668e759c37be8712febf09ec2823d257.gz -o "-g -v 1 -r 5 -w" -- sai -- sai

15 wins, 41 losses
The first net is worse than the second
264.gz   v networks ( 56 games)
              wins        black       white
264.gz     15 26.79%    6 24.00%    9 29.03%
networks   41 73.21%   19 76.00%   22 70.97%
                       25 44.64%   31 55.36%
l1t1 commented 4 years ago

validation -g 1 -k sai114_lz250 -n 6ee.gz -o "-g -v 400 -r 5 -w" -n networks/3d415846183a7f51a40aaa80a007d886668e759c37be8712febf09ec2823d257.gz -o "-g -v 1 -r 5 -w" -- sai -- sai

22 wins, 48 losses
The first net is worse than the second
6ee.gz   v networks ( 70 games)
              wins        black       white
6ee.gz     22 31.43%    8 27.59%   14 34.15%
networks   48 68.57%   21 72.41%   27 65.85%
                       29 41.43%   41 58.57%
l1t1 commented 4 years ago

validation -g 2 -k sai119_lz250 -n 7eb.gz -o "-g -v 400 -r 5 -w" -n networks/3d415846183a7f51a40aaa80a007d886668e759c37be8712febf09ec2823d257.gz -o "-g -v 1 -r 5 -w" -- sai -- sai

24 wins, 50 losses
The first net is worse than the second
7eb.gz   v networks ( 74 games)
              wins        black       white
7eb.gz     24 32.43%   12 32.43%   12 32.43%
networks   50 67.57%   25 67.57%   25 67.57%
                       37 50.00%   37 50.00%
l1t1 commented 4 years ago

validation -g 1 -k sai120_lz250 -n 8c4.gz -o "-g -v 400 -r 5 -w" -n networks/3d415846183a7f51a40aaa80a007d886668e759c37be8712febf09ec2823d257.gz -o "-g -v 1 -r 5 -w" -- sai -- sai

39 wins, 63 losses
The first net is worse than the second
8c4.gz   v networks ( 102 games)
              wins        black       white
8c4.gz     39 38.24%   18 37.50%   21 38.89%
networks   63 61.76%   30 62.50%   33 61.11%
                       48 47.06%   54 52.94%
l1t1 commented 4 years ago

validation -g 2 -k sai121_lz250 -n 485.gz -o "-g -v 400 -r 5 -w" -n networks/3d415846183a7f51a40aaa80a007d886668e759c37be8712febf09ec2823d257.gz -o "-g -v 1 -r 5 -w" -- sai -- sai

26 wins, 51 losses
The first net is worse than the second
485.gz   v networks ( 77 games)
              wins        black       white
485.gz     26 33.77%   16 35.56%   10 31.25%
networks   51 66.23%   29 64.44%   22 68.75%
                       45 58.44%   32 41.56%
l1t1 commented 4 years ago

validation -g 1 -k sai122_lz250 -n 585.gz -o "-g -v 400 -r 5 -w" -n networks/3d415846183a7f51a40aaa80a007d886668e759c37be8712febf09ec2823d257.gz -o "-g -v 1 -r 5 -w" -- sai -- sai

29 wins, 54 losses
The first net is worse than the second
585.gz   v networks ( 83 games)
              wins        black       white
585.gz     29 34.94%   13 34.21%   16 35.56%
networks   54 65.06%   25 65.79%   29 64.44%
                       38 45.78%   45 54.22%
l1t1 commented 4 years ago

sai 9x192 net a48 validation -g 2 -k saia48_lz250 -n a48.gz -o "-g -v 400 -r 5 -w" -n networks/3d415846183a7f51a40aaa80a007d886668e759c37be8712febf09ec2823d257.gz -o "-g -v 1 -r 5 -w" -- sai -- sai

20 wins, 46 losses
The first net is worse than the second
a48.gz   v networks ( 66 games)
              wins        black       white
a48.gz     20 30.30%   12 32.43%    8 27.59%
networks   46 69.70%   25 67.57%   21 72.41%
                       37 56.06%   29 43.94%
l1t1 commented 4 years ago

validation -g 1 -k sai124_lz250 -n 14b.gz -o "-g -v 400 -r 5 -w" -n networks/3d415846183a7f51a40aaa80a007d886668e759c37be8712febf09ec2823d257.gz -o "-g -v 1 -r 5 -w" -- sai -- sai

21 wins, 47 losses
The first net is worse than the second
14b.gz   v networks ( 68 games)
              wins        black       white
14b.gz     21 30.88%    8 27.59%   13 33.33%
networks   47 69.12%   21 72.41%   26 66.67%
                       29 42.65%   39 57.35%
l1t1 commented 4 years ago

validation -g 1 -k sai125_lz250 -n 108.gz -o "-g -v 400 -r 5 -w" -n networks/3d415846183a7f51a40aaa80a007d886668e759c37be8712febf09ec2823d257.gz -o "-g -v 1 -r 5 -w" -- sai -- sai

5 wins, 31 losses
The first net is worse than the second
108.gz   v networks ( 36 games)
              wins        black       white
108.gz      5 13.89%    3 15.79%    2 11.76%
networks   31 86.11%   16 84.21%   15 88.24%
                       19 52.78%   17 47.22%
l1t1 commented 4 years ago

validation -g 1 -k sai126_lz250 -n 26f.gz -o "-g -v 400 -r 5 -w" -n networks/3d415846183a7f51a40aaa80a007d886668e759c37be8712febf09ec2823d257.gz -o "-g -v 1 -r 5 -w" -- sai -- sai

14 wins, 40 losses
The first net is worse than the second
26f.gz   v networks ( 54 games)
              wins        black       white
26f.gz     14 25.93%    7 25.93%    7 25.93%
networks   40 74.07%   20 74.07%   20 74.07%
                       27 50.00%   27 50.00%
l1t1 commented 4 years ago

validation -g 1 -k sai127_lz250 -n cae.gz -o "-g -v 400 -r 5 -w" -n networks/3d415846183a7f51a40aaa80a007d886668e759c37be8712febf09ec2823d257.gz -o "-g -v 1 -r 5 -w" -- sai -- sai

23 wins, 49 losses
The first net is worse than the second
cae.gz   v networks ( 72 games)
              wins        black       white
cae.gz     23 31.94%   12 32.43%   11 31.43%
networks   49 68.06%   25 67.57%   24 68.57%
                       37 51.39%   35 48.61%
l1t1 commented 4 years ago

validation -g 1 -k sai129_lz250 -n b30.gz -o "-g -v 400 -r 5 -w" -n networks/3d415846183a7f51a40aaa80a007d886668e759c37be8712febf09ec2823d257.gz -o "-g -v 1 -r 5 -w" -- sai -- sai

54 wins, 77 losses
The first net is worse than the second
b30.gz   v networks ( 131 games)
              wins        black       white
b30.gz     54 41.22%   28 41.79%   26 40.63%
networks   77 58.78%   39 58.21%   38 59.38%
                       67 51.15%   64 48.85%
l1t1 commented 4 years ago

validation -g 2 -k sai129_lz91 -n b30.gz -o "-g -v 100 -r 5 -w" -n b3b.gz -o "-g -v 100 -r 5 -w" -- sai -- sai

73 wins, 94 losses
The first net is worse than the second
b30.gz   v b3b.gz   ( 167 games)
              wins        black       white
b30.gz     73 43.71%   41 44.57%   32 42.67%
b3b.gz     94 56.29%   51 55.43%   43 57.33%
                       92 55.09%   75 44.91%
l1t1 commented 4 years ago

validation -g 1 -k sai139_lz250 -n 849.gz -o "-g -v 400 -r 5 -w" -n networks/3d415846183a7f51a40aaa80a007d886668e759c37be8712febf09ec2823d257.gz -o "-g -v 1 -r 5 -w" -- sai -- sai

131 wins, 147 losses
The first net is worse than the second
849.gz   v networks ( 278 games)
              wins        black       white
849.gz    131 47.12%   73 47.40%   58 46.77%
networks  147 52.88%   81 52.60%   66 53.23%
                      154 55.40%  124 44.60%
l1t1 commented 4 years ago

validation -g 1 -k sai143_lz250 -n ca7.gz -o "-g -v 400 -r 5 -w" -n networks/3d415846183a7f51a40aaa80a007d886668e759c37be8712febf09ec2823d257.gz -o "-g -v 1 -r 5 -w" -- sai -- sai

84 wins, 79 losses
163 games played.
Status: 0 LLR -0.329069 Lower Bound -2.94444 Upper Bound 2.94444
l1t1 commented 4 years ago

validation -g 1 -k sai150_lz250 -n c8a.gz -o "-g -v 400 -r 5 -w" -n networks/3d415846183a7f51a40aaa80a007d886668e759c37be8712febf09ec2823d257.gz -o "-g -v 1 -r 5 -w" -- sai -- sai

4 wins, 9 losses
13 games played.
Status: 0 LLR -0.625004 Lower Bound -2.94444 Upper Bound 2.94444
l1t1 commented 4 years ago

validation -g 1 -k sai156_lz250 -n 208.gz -o "-g -v 400 -r 5 -w" -n networks/3d415846183a7f51a40aaa80a007d886668e759c37be8712febf09ec2823d257.gz -o "-g -v 1 -r 5 -w" -- sai -- sai

208.gz   v networks ( 12 games)
              wins        black       white
208.gz      6 50.00%    3 50.00%    3 50.00%
networks    6 50.00%    3 50.00%    3 50.00%
                        6 50.00%    6 50.00%
12 games played.
Status: 0 LLR -0.0713402 Lower Bound -2.94444 Upper Bound 2.94444
l1t1 commented 4 years ago

validation -g 1 -k sai159_lz250 -n 6c9.gz -o "-g -v 400 -r 5 -w" -n networks/3d415846183a7f51a40aaa80a007d886668e759c37be8712febf09ec2823d257.gz -o "-g -v 1 -r 5 -w" -- sai -- sai

1 wins, 4 losses
5 games played.
Status: 0 LLR -0.42713 Lower Bound -2.94444 Upper Bound 2.94444
q
storeSprt
6c9.gz   v networks ( 5 games)
              wins        black       white
6c9.gz      1 20.00%    0  0.00%    1 25.00%
networks    4 80.00%    1 100.00%    3 75.00%
                        1 20.00%    4 80.00%
5 games played.
Status: 0 LLR -0.42713 Lower Bound -2.94444 Upper Bound 2.94444
l1t1 commented 4 years ago

validation -g 1 -k sai165_lz250 -n b7b.gz -o "-g -v 400 -r 5 -w" -n networks/3d415846183a7f51a40aaa80a007d886668e759c37be8712febf09ec2823d257.gz -o "-g -v 1 -r 5 -w" -- sai -- sai

42 wins, 66 losses
The first net is worse than the second
b7b.gz   v networks ( 108 games)
              wins        black       white
b7b.gz     42 38.89%   24 40.00%   18 37.50%
networks   66 61.11%   36 60.00%   30 62.50%
                       60 55.56%   48 44.44%
l1t1 commented 4 years ago

validation -g 1 -k sai166_lz250 -n 247.gz -o "-g -v 400 -r 5 -w" -n networks/3d415846183a7f51a40aaa80a007d886668e759c37be8712febf09ec2823d257.gz -o "-g -v 1 -r 5 -w" -- sai -- sai

109 wins, 127 losses
The first net is worse than the second
247.gz   v networks ( 236 games)
              wins        black       white
247.gz    109 46.19%   53 46.90%   56 45.53%
networks  127 53.81%   60 53.10%   67 54.47%
                      113 47.88%  123 52.12%
l1t1 commented 4 years ago

validation -g 1 -k sai143_lz250 -n ca7.gz -o "-g -v 400 -r 5 -w" -n networks/3d415846183a7f51a40aaa80a007d886668e759c37be8712febf09ec2823d257.gz -o "-g -v 1 -r 5 -w" -- sai -- sai another run of sai 143

27 wins, 52 losses
The first net is worse than the second
ca7.gz   v networks ( 79 games)
              wins        black       white
ca7.gz     27 34.18%   12 33.33%   15 34.88%
networks   52 65.82%   24 66.67%   28 65.12%
                       36 45.57%   43 54.43%
l1t1 commented 4 years ago

validation -g 1 -k sai169_lz250 -n b02.gz -o "-g -v 400 -r 5 -w" -n networks/3d415846183a7f51a40aaa80a007d886668e759c37be8712febf09ec2823d257.gz -o "-g -v 1 -r 5 -w" -- sai -- sai

230 wins, 236 losses
The first net is worse than the second
b02.gz   v networks ( 466 games)
              wins        black       white
b02.gz    230 49.36%  116 49.36%  114 49.35%
networks  236 50.64%  119 50.64%  117 50.65%
                      235 50.43%  231 49.57%
l1t1 commented 4 years ago

validation -g 1 -k sai170_lz250 -n 6dc.gz -o "-g -v 400 -r 5 -w" -n networks/3d415846183a7f51a40aaa80a007d886668e759c37be8712febf09ec2823d257.gz -o "-g -v 1 -r 5 -w" -- sai -- sai

6dc.gz   v networks ( 679 games)
              wins        black       white
6dc.gz    356 52.43%  182 52.45%  174 52.41%
networks  323 47.57%  165 47.55%  158 47.59%
                      347 51.10%  332 48.90%
679 games played.
Status: 0 LLR -0.120381 Lower Bound -2.94444 Upper Bound 2.94444
l1t1 commented 4 years ago

validation -g 1 -k sai171_lz250 -n 2bb.gz -o "-g -v 400 -r 5 -w" -n networks/3d415846183a7f51a40aaa80a007d886668e759c37be8712febf09ec2823d257.gz -o "-g -v 1 -r 5 -w" -- sai -- sai

2bb.gz   v networks ( 15 games)
              wins        black       white
2bb.gz      6 40.00%    2 40.00%    4 40.00%
networks    9 60.00%    3 60.00%    6 60.00%
                        5 33.33%   10 66.67%
15 games played.
Status: 0 LLR -0.409561 Lower Bound -2.94444 Upper Bound 2.94444
l1t1 commented 4 years ago

validation -g 1 -k sai172_lz250 -n 070.gz -o "-g -v 400 -r 5 -w" -n networks/3d415846183a7f51a40aaa80a007d886668e759c37be8712febf09ec2823d257.gz -o "-g -v 1 -r 5 -w" -- sai -- sai

070.gz   v networks ( 9 games)
              wins        black       white
070.gz      3 33.33%    1 33.33%    2 33.33%
networks    6 66.67%    2 66.67%    4 66.67%
                        3 33.33%    6 66.67%
9 games played.
Status: 0 LLR -0.395861 Lower Bound -2.94444 Upper Bound 2.94444
l1t1 commented 4 years ago

validation -g 1 -k sai181_lz250 -n 39e.gz -o "-g -v 400 -r 5 -w" -n networks/3d415846183a7f51a40aaa80a007d886668e759c37be8712febf09ec2823d257.gz -o "-g -v 1 -r 5 -w" -- sai -- sai

39e.gz   v networks ( 21 games)
              wins        black       white
39e.gz     12 57.14%    5 62.50%    7 53.85%
networks    9 42.86%    3 37.50%    6 46.15%
                        8 38.10%   13 61.90%
21 games played.
Status: 0 LLR 0.200087 Lower Bound -2.94444 Upper Bound 2.94444
l1t1 commented 4 years ago

validation -g 1 -k sai185_lz250 -n 54b.gz -o "-g -v 400 -r 5 -w" -n networks/3d415846183a7f51a40aaa80a007d886668e759c37be8712febf09ec2823d257.gz -o "-g -v 1 -r 5 -w" -- sai -- sai

58 wins, 51 losses
109 games played.
Status: 0 LLR 0.149321 Lower Bound -2.94444 Upper Bound 2.94444
l1t1 commented 4 years ago

validation -g 1 -k sai187_lz250 -n 923.gz -o "-g -v 400 -r 5 -w" -n networks/3d415846183a7f51a40aaa80a007d886668e759c37be8712febf09ec2823d257.gz -o "-g -v 1 -r 5 -w" -- sai -- sai

923.gz   v networks ( 26 games)
              wins        black       white
923.gz     13 50.00%    5 50.00%    8 50.00%
networks   13 50.00%    5 50.00%    8 50.00%
                       10 38.46%   16 61.54%
26 games played.
Status: 0 LLR -0.14203 Lower Bound -2.94444 Upper Bound 2.94444
nanzi commented 4 years ago

./validation.exe -k ../PkAutoSave/lz258_sai240/ -n 40b.gz -o "-g -v 1 -r 5 -w" -n networks/538efaaf1c9521ad0f26ae06650f9340b63174f622aa1eabd8abf43e49dbe023.gz -o "-g -v 400 -r 5 -w" -- sai -- sai

41 wins, 65 losses
The first net is worse than the second
40b.gz   v networks ( 106 games)
              wins        black       white
40b.gz     41 38.68%   21 38.89%   20 38.46%
networks   65 61.32%   33 61.11%   32 61.54%
                       54 50.94%   52 49.06%
nanzi commented 4 years ago

./validation.exe -g2 -k ../PkAutoSave/lz258_sai230/ -n 40b.gz -o "-g -v 1 -r 5 -w" -n networks/6ebb71b9e7c07993c734459e486722248397f726b83b6e7a55dd4e87ff857c86.gz -o "-g -v 400 -r 5 -w" -- sai -- sai

The first net is worse than the second
40b.gz   v networks ( 97 games)
              wins        black       white
40b.gz     36 37.11%   19 38.00%   17 36.17%
networks   61 62.89%   31 62.00%   30 63.83%
                       50 51.55%   47 48.45%

I'll make more validation matches and put the results to here lz258/lz250 could be the targets, then the results gzips will be released under vali-lz250v1/vali-lz258v1 tags

nanzi commented 4 years ago

./validation.exe -g2 -k ../PkAutoSave/lz258s_sai220/ -n 40b.gz -o "-g -v 1 -r 5 -w" -n networks/05d17da9958c536b94afd699fd7455ad64b88b4e44394de85c9bb335530a2a55.gz -o "-g -v 400 -r 5 -w" -- sai -- sai

31 wins, 56 losses
The first net is worse than the second
40b.gz   v networks ( 87 games)
              wins        black       white
40b.gz     31 35.63%   19 37.25%   12 33.33%
networks   56 64.37%   32 62.75%   24 66.67%
                       51 58.62%   36 41.38%
nanzi commented 4 years ago

It seems that white's ability is decreasing.

nanzi commented 4 years ago

./validation.exe -g2 -k ../PkAutoSave/lz258s_sai210/ -n 40b.gz -o "-g -v 1 -r 5 -w" -n networks/b019a4d6506485b5524eb0da3182b52474606ee8d9b1731d6529ff50a8100dd0.gz -o "-g -v 400 -r 5 -w" -- sai -- sai

32 wins, 57 losses
The first net is worse than the second
40b.gz   v networks ( 89 games)
              wins        black       white
40b.gz     32 35.96%   15 34.88%   17 36.96%
networks   57 64.04%   28 65.12%   29 63.04%
                       43 48.31%   46 51.69%

This method (vs LZ-best on visits1) couldn't tell much for now SAI's weights are much better on visits 400.