Hyperparameter Tuning - Githubissues

scspinney / pgm-fmri

0 stars 0 forks source link

Hyperparameter Tuning #6

Open amimem opened 3 years ago

amimem commented 3 years ago

We need to search for good hyperparameter more thoroughly:

Optimizer: SGD, Adam:
- Learning rate, Momentum
- b1,b2 for Adam
Agreement Threshold:
- Test more values around 0.9
Geometric Mean
Inverse Scaling of Gradients