search

mws262 / qwop-controls

0 stars 0 forks source link

Workers jam up too easily with the current node locking. #2

Closed mws262 closed 5 years ago

mws262 commented 5 years ago

With the UCB sampler, workers tend to deadlock when there are a lot of workers. I think that some sections of the tree might be being locked from other workers too much. When one worker is expanding from a node, it doesn't allow other works to also try another potential action from that node. This should be changed.

mws262 commented 5 years ago

Changed the locks around and things are good enough for now. In general the locks are more conservative than they need to be, but it's easier to avoid weird cases that way. Setting the UCB "c" value to different things for different workers helps a ton.