search

lzamparo / embedding

Learning semantic embeddings for TF binding preferences directly from sequence
Other
0 stars 0 forks source link

Test Adam versus Nesterov momentum versus RMSprop #11

Open lzamparo opened 7 years ago

lzamparo commented 7 years ago

Maybe the last is superfluous, but I'd like to see if Adam or Adagrad (with reset) will help learning go faster & better than simply using Nesterov momentum.

lzamparo commented 6 years ago

First tests show no significant differences in quickness of the reduction of macrobatch training error. But maybe differences will show up in longer runs over multiple epochs.

lzamparo commented 6 years ago

Running tests now...