SanchoGGP / ggp-base

The General Game Playing Base Package
8 stars 4 forks source link

Fast loss in Pentago #281

Open arr28 opened 9 years ago

arr28 commented 9 years ago

We lost this match quickly. Logged locally. On turn 28 we had early termination because of a complete root at depth 23. However, two odd things...

  1. There were some unexpanded children of the root. Is that wrong?
31/05/2015, 02:49:49.053    INFO    Starting turn 28
31/05/2015, 02:49:49.053    INFO    MCTS iterations last turn = 55659334
31/05/2015, 02:49:49.053    INFO    Free all but rooted in state: ( ( true ( cellHolds 4 1 2 black ) ), ( true ( cellHolds 2 2 2 black ) ), ( true ( cellHolds 4 3 2 red ) ), ( true ( cellHolds 4 2 1 red ) ), ( true ( cellHolds 4 2 2 red ) ), ( true ( rotateControl black ) ), ( true ( cellHolds 4 2 3 black ) ), ( true ( cellHolds 1 2 2 black ) ), ( true ( cellHolds 3 2 3 black ) ), ( true ( cellHolds 3 3 3 black ) ), ( true ( cellHolds 3 2 1 red ) ), ( true ( cellHolds 3 3 1 red ) ), ( true ( cellHolds 3 3 2 red ) ), ( true ( cellHolds 3 1 2 black ) ), ( true ( cellHolds 3 2 2 red ) ) )
31/05/2015, 02:49:49.587    WARN    Discarding TreeEdge on return to UncappedPool
31/05/2015, 02:49:49.633    INFO    Freed 99% of allocated nodes (732043 of 732044)
31/05/2015, 02:49:49.633    INFO    Encountered childless root - must re-expand
31/05/2015, 02:49:49.633    INFO    Root has 8 children, and is not complete
31/05/2015, 02:50:07.866    INFO    Mark root complete
31/05/2015, 02:50:07.866    INFO    Move search complete
31/05/2015, 02:50:07.866    INFO    Move search started
31/05/2015, 02:50:07.866    INFO    Move search complete
31/05/2015, 02:50:07.936    INFO    Early search termination because root is complete
31/05/2015, 02:50:07.936    INFO    Average fringe depth: 22.40712232962907
31/05/2015, 02:50:07.936    INFO    Fringe depth variability: 0.05953064316568437
31/05/2015, 02:50:07.936    INFO    Average branching factor: 5.190819683454223
31/05/2015, 02:50:07.936    INFO    Tree aspect ratio: 3.087572050198647
31/05/2015, 02:50:07.936    INFO    Move ( rotate 3 clockwise ) scores -454.00 (selectionScore score -452.95, selection count 153964, ref 34361357919, complete [23])
31/05/2015, 02:50:07.936    INFO    Move ( rotate 2 clockwise ) scores -486.00 (selectionScore score -484.88, selection count 7383, ref 34360878411, complete [7])
31/05/2015, 02:50:07.936    WARN    Unexpanded child of root for move: ( rotate 2 counterclockwise )
31/05/2015, 02:50:07.936    INFO    Move ( rotate 4 clockwise ) scores -486.00 (selectionScore score -484.88, selection count 6144, ref 34360520536, complete [7])
31/05/2015, 02:50:07.936    INFO    Move ( rotate 4 counterclockwise ) scores -486.00 (selectionScore score -484.88, selection count 4539, ref 42949742177, complete [7])
31/05/2015, 02:50:07.936    WARN    Unexpanded child of root for move: ( rotate 1 counterclockwise )
31/05/2015, 02:50:07.936    WARN    Unexpanded child of root for move: ( rotate 1 clockwise )
31/05/2015, 02:50:07.936    INFO    Move ( rotate 3 counterclockwise ) scores -486.00 (selectionScore score -484.88, selection count 6905, ref 25770756767, complete [7])
31/05/2015, 02:50:07.936    INFO    Most likely path: ( rotate 3 clockwise ), ( place 4 3 1 ) | ( rotate 3 counterclockwise ) | ( place 4 1 1 ), ( rotate 3 clockwise ), ( place 3 1 3 ) | ( rotate 3 counterclockwise ) | ( place 3 1 3 ), ( rotate 3 clockwise ), ( place 4 1 3 ) | ( rotate 3 clockwise ) | ( place 2 2 1 ), ( rotate 3 counterclockwise ), ( place 2 1 2 ) | ( rotate 2 clockwise ) | ( place 2 1 3 ), ( rotate 2 counterclockwise ), ( place 1 2 3 ) | ( rotate 2 clockwise ) |
31/05/2015, 02:50:07.936    INFO    Num nodes in use: 155099
31/05/2015, 02:50:07.936    INFO    Num true rollouts added: 1536714
31/05/2015, 02:50:07.936    INFO    Num terminal nodes revisited: 55277586
31/05/2015, 02:50:07.936    INFO    Num incomplete nodes: 0
31/05/2015, 02:50:07.936    INFO    Num completely explored branches: 32060
31/05/2015, 02:50:07.936    INFO    Current observed rollout score range: [0, 100]
31/05/2015, 02:50:07.936    INFO    Playing move: ( rotate 3 clockwise )
  1. Two turns later, the completion depth suddenly dropped to 5.
31/05/2015, 02:51:08.504    INFO    MCTS iterations last turn = 10
31/05/2015, 02:51:08.504    INFO    Free all but rooted in state: ( ( true ( cellHolds 4 1 2 black ) ), ( true ( rotateControl red ) ), ( true ( cellHolds 2 2 2 black ) ), ( true ( cellHolds 3 1 2 red ) ), ( true ( cellHolds 3 3 2 black ) ), ( true ( cellHolds 4 3 2 red ) ), ( true ( cellHolds 4 2 1 red ) ), ( true ( cellHolds 4 2 2 red ) ), ( true ( cellHolds 3 1 1 red ) ), ( true ( cellHolds 3 3 1 black ) ), ( true ( cellHolds 4 2 3 black ) ), ( true ( cellHolds 1 2 2 black ) ), ( true ( cellHolds 3 2 3 black ) ), ( true ( cellHolds 3 2 1 red ) ), ( true ( cellHolds 4 1 1 red ) ), ( true ( cellHolds 3 2 2 red ) ) )
31/05/2015, 02:51:08.608    INFO    Freed 97% of allocated nodes (111635 of 114177)
31/05/2015, 02:51:08.608    INFO    Root has 1 children, and is not complete
31/05/2015, 02:51:08.608    INFO    Move search started
31/05/2015, 02:51:08.934    INFO    Mark root complete
31/05/2015, 02:51:08.934    INFO    Move search complete
31/05/2015, 02:51:09.128    INFO    Early search termination because root is complete
31/05/2015, 02:51:09.128    INFO    Average fringe depth: 11.543591803937323
31/05/2015, 02:51:09.128    INFO    Fringe depth variability: 0.05518355045698864
31/05/2015, 02:51:09.128    INFO    Average branching factor: 4.829086365951631
31/05/2015, 02:51:09.128    INFO    Tree aspect ratio: 2.1223048339887947
31/05/2015, 02:51:09.128    INFO    Move noop scores -490.00 (selectionScore score -467.74, selection count 3420, ref 51540719955, complete [5])
31/05/2015, 02:51:09.128    INFO    Most likely path: noop, ( rotate 4 clockwise ) | ( place 2 3 2 ), ( rotate 1 counterclockwise ), ( place 3 1 3 ) | ( rotate 1 counterclockwise ) | ( place 1 3 2 ), ( rotate 1 counterclockwise ), ( place 4 3 3 ) | ( rotate 3 counterclockwise ) | ( place 2 1 2 ), ( rotate 1 counterclockwise ),
31/05/2015, 02:51:09.128    INFO    Num nodes in use: 5244
31/05/2015, 02:51:09.128    INFO    Num true rollouts added: 15503
31/05/2015, 02:51:09.128    INFO    Num terminal nodes revisited: 186
31/05/2015, 02:51:09.128    INFO    Num incomplete nodes: 0
31/05/2015, 02:51:09.128    INFO    Num completely explored branches: 875
31/05/2015, 02:51:09.128    INFO    Current observed rollout score range: [0, 100]
31/05/2015, 02:51:09.128    INFO    Playing move: noop

More dodgy play in games where a single player keeps control. Possibly related to #224?? The node pool reached 96% at turn 14, but didn't get above 80% subsequently.

SteveDraper commented 9 years ago

Unexpanded children are potentially fine. Once we have a complete path other paths are trimmed. However, normally it would be just the complete wins that are left, so in the event of a node being a complete loss I would expect it to itself have been trimmed, or (if it's the root) ALL its children to be missing (I think).