search

ethanfetaya / NRI

Neural relational inference for interacting systems - pytorch
MIT License
741 stars 157 forks source link

Annealed Temperature in Gumbel Softmax #14

Open jramapuram opened 5 years ago

jramapuram commented 5 years ago

It doesn’t look like the temperature is annealed in your gumbel softmax. Is there a reason for this as it is not standard? @tkipf

ethanfetaya commented 5 years ago

Mostly for simplicity and because it worked well without. Adding annealing would add the extra annealing hyperparameters to tune. If you add and see any noticeable improvement please let us know!