search

buriburisuri / sugartensor

A slim tensorflow wrapper that provides syntactic sugar for tensor variables. This library will be helpful for practical deep learning researchers not beginners.
MIT License
372 stars 63 forks source link

Gradient Clipping #14

Open AndreasMadsen opened 7 years ago

AndreasMadsen commented 7 years ago

Does sg_train support gradient clipping?

buriburisuri commented 7 years ago

@AndreasMadsen Nope now. Instead, Maxprop(the default optimizer of sugartensor) has a inherent gradient clipping effect(clipping value is 1.0). If you need a flexible clipping value or for other optimizer, please let me know details.

Thank you.

AndreasMadsen commented 7 years ago

If you need a flexible clipping value or for other optimizer, please let me know details.

I don't know specifically what I need, I just know I need to experiment with different options.