search

JianGoForIt / YellowFin

auto-tuning momentum SGD optimizer
Apache License 2.0
422 stars 93 forks source link

Cannot operate on graphs with gradients that are None. #9

Closed drewlinsley closed 7 years ago

drewlinsley commented 7 years ago

Error is thrown during the after_apply operation in the yellowfin class. My suggestion is to screen for Nones during the apply_gradients operation. This is similar to the apply_gradients operation in the official repo: https://github.com/tensorflow/tensorflow/blob/master/tensorflow/python/training/optimizer.py#L426

JianGoForIt commented 7 years ago

Hi @drewlinsley, Thanks for the suggestion. We will incorporate it from the PR here soon.

https://github.com/JianGoForIt/YellowFin/pull/6.

Cheers,

Jian