adapt code for pytorch 1.2

harbecke / HexHex

AlphaGo Zero adaptation for Hex

GNU General Public License v3.0

20 stars 4 forks source link

adapt code for pytorch 1.2 #25

Closed harbecke closed 4 years ago

harbecke commented 4 years ago

pytorch 1.2 was released. some of the relevant features for us are:

tensorboard is natively supported: from torch.utils.tensorboard import SummaryWriter
AdamW optimizer is included (an Adam Optimizer that works with weight decay)
there is a nn.Transformer module, if we want to experiment with transformer models

harbecke commented 4 years ago

I created a branch for this and adapted the SummaryWriter of tensorboard 396edb186e588fc1dc0cdff3fe44c19e7feadbaa. Unfortunately the terminal logging is now double again.

harbecke commented 4 years ago

added AdamW optimizer 0ffb489d5038ffdd9250912aec3dcfd7b9857b62

harbecke commented 4 years ago

merged with dbb7a87