search

google-research / tuning_playbook

A playbook for systematically maximizing the performance of deep learning models.
Other
26.29k stars 2.18k forks source link

How to examining the training curves about a multi-task learning model? #59

Closed JohnHerry closed 5 months ago

JohnHerry commented 1 year ago

I had read the part about how to read training curves, Is that questions still ok for a multi-task training pipeline?

varungodbole commented 5 months ago

Yeah our advice should still be relevant for a multi-task setting. Often in multi-task settings, you can make your life easier if you come up with a single loss that is a function of all the different tasks. And attempt to directly optimize that.

JohnHerry commented 5 months ago

Thanks for the help！