search

namisan / mt-dnn

Multi-Task Deep Neural Networks for Natural Language Understanding
MIT License
2.22k stars 412 forks source link

Posterior Differential Regularization implementation #211

Closed shaked571 closed 3 years ago

shaked571 commented 3 years ago

Hi, Im looking for the PDR (Posterior Differential Regularization ) implementation and couldnt find it in the repo, Can you please advice?

namisan commented 3 years ago

Please use the losses: https://github.com/namisan/mt-dnn/blob/471f717a25ab744e710591274c3ec098f5f4d0ad/mt_dnn/loss.py#L147 https://github.com/namisan/mt-dnn/blob/471f717a25ab744e710591274c3ec098f5f4d0ad/mt_dnn/loss.py#L166