search

Tencent / PhoenixGo

Go AI program which implements the AlphaGo Zero paper
Other
2.88k stars 577 forks source link

Strength comparison to LeelaZero or Facebook ELF #1

Open bood opened 6 years ago

bood commented 6 years ago

Did you run any test for a strength comparison with previous published Go programs? If so, could you publish your result too? Thanks.

BTW: is this published network the same as the one used on the World AI Go Tournament 2018?

godmoves commented 6 years ago

It seems that they use a 40b net on the World AI Go Tournament.

Nefeste commented 6 years ago

LZ-ELF (62b5417b) is stronger than this version of BensonDarr "off-the-shelf" without TensorRT. Probably need some tuning with pondering/time settings/config tunung/better network to get this bot play at the level of LZ-ELF or higher.

godmoves commented 6 years ago

FYI, some tests are mentioned here. gcp/leela-zero#1405

baduk1 commented 6 years ago

On my PC (2x 1080ti ASUS Strix SLI, Core i9 64 Gb) LZ-ELF is always winning PhoenixGo Here is 60 sec game (150-650k visits average) https://www.youtube.com/watch?v=WY4tV5w_g0w Here is a game when as a handicap ELF starts from 10-10 and still wins on 30 sec https://www.youtube.com/watch?v=M-zwD2855Us

Godady commented 6 years ago

The point is the released PhoenixGo weight is too weak, not good enough for play against Elf weight.