search

mgrankin / ru_transformers

Apache License 2.0
776 stars 108 forks source link

temperature vs overfitting? #24

Closed eps696 closed 4 years ago

eps696 commented 4 years ago

this may be rather generic question for NLP/NLG - does temperature increase help fighting overfit somehow?

mgrankin commented 4 years ago

No. Temperature doesn't applicable during the training. It's a parameter you use to generate text.

eps696 commented 4 years ago

sure, i mean - does increased temperature helps to provide more sensible variety from overfitted (for whatever reasons) models at generation stage? or it would just "make some noise", going pure schizo?