search

pytorch / ELF

ELF: a platform for game research with AlphaGoZero/AlphaZero reimplementation
Other
3.37k stars 566 forks source link

how to set the parameter to run elf_opengo at same playout / visits of leelazero #145

Open l1t1 opened 5 years ago

l1t1 commented 5 years ago

I use command line

D:\tool\go_gui\gogui-twogtp -black "D:\elfv2\play_opengo_v2\elf_gpu\df_console.exe --load d:/elfv2.bin --mcts_rollout_per_thread 80" -white "D:\leela-zero-0.16-win64\leelaz.exe --gtp -w D:\elfv2.gz --noponder -v 1601"  -games 10 -sgffile fbg_lzelfv2 -auto -komi 7.5

elf_opengo memory 1308780k avg cpu usage 5% leelaz memory 455112k avg cpu usage 25% my gpu NVIDIA GT 730 my cpu intel i5 6600 3.3Ghz

l1t1 commented 5 years ago

opengo of my setting is weaker than lz using same weight

# Black: DF2
# BlackCommand: D:\elfv2\play_opengo_v2\elf_gpu\df_console.exe --load d:/elfv2.bin --mcts_rollout_per_thread 80
# BlackLabel: DF2
# BlackVersion: 1.0
# Date: February 26, 2019 7:49:18 AM CST
# Host: PC
# Komi: 7.5
# Referee: -
# Size: 19
# White: Leela Zero
# WhiteCommand: D:\leela-zero-0.16-win64\leelaz.exe --gtp -w D:\elfv2.gz --noponder -v 1601
# WhiteLabel: Leela Zero
# WhiteVersion: 0.16
# Xml: 0
#
#GAME   RES_B   RES_W   RES_R   ALT DUP LEN TIME_B  TIME_W  CPU_B   CPU_W   ERR ERR_MSG
0   W+R W+R W+R 0   -   128 721.9   1022.4  0   0   0   
1   W+R W+R W+R 0   -   56  325.1   323.9   0   0   0   
2   W+R W+R W+R 0   -   56  314.6   320.6   0   0   0   
3   W+R W+R W+R 0   -   158 893.4   986.5   0   0   0
qucheng commented 5 years ago

seems your are using --mcts_rollout_per_thread 80

qucheng commented 5 years ago

Try to change to 800. Also switch B and W to get an unbiased estimate

l1t1 commented 5 years ago

elf_opengo memory 1935048k cpu usage 5%

D:\tool\go_gui\gogui-twogtp -white "D:\elfv2\play_opengo_v2\elf_gpu\df_console.exe --load d:/elfv2.bin --mcts_rollout_per_thread 800" -black "D:\leela-zero-0.16-win64\leelaz.exe --gtp -w D:\elfv2.gz --noponder -v 1601"  -games 10 -sgffile fbgw_lzelfv2 -auto -komi 7.5
l1t1 commented 5 years ago

800 is too slow, and result isnt good

# Black: Leela Zero
# BlackCommand: D:\leela-zero-0.16-win64\leelaz.exe --gtp -w D:\elfv2.gz --noponder -v 1601
# BlackLabel: Leela Zero
# BlackVersion: 0.16
# Date: February 26, 2019 11:54:16 AM CST
# Host: PC
# Komi: 7.5
# Referee: -
# Size: 19
# White: DF2
# WhiteCommand: D:\elfv2\play_opengo_v2\elf_gpu\df_console.exe --load d:/elfv2.bin --mcts_rollout_per_thread 800
# WhiteLabel: DF2
# WhiteVersion: 1.0
# Xml: 0
#
#GAME   RES_B   RES_W   RES_R   ALT DUP LEN TIME_B  TIME_W  CPU_B   CPU_W   ERR ERR_MSG
0   B+R B+R B+R 0   -   159 1313.4  8781.8  0   0   0