I got xent of 3-4 after 30000 training steps, is this normal?

nlpyang / BertSum

Code for paper Fine-tune BERT for Extractive Summarization

Apache License 2.0

1.47k stars 423 forks source link

I got xent of 3-4 after 30000 training steps, is this normal? #119

Open Anothernewcomer opened 2 years ago

Anothernewcomer commented 2 years ago

xent started out aroud 40-50, rapidly decrease to 3-4 and seemed to stop deceasing, Is this normal or is there something wrong with my data? Pleases guys give me some replys o(╥﹏╥)o

oblialbum commented 2 years ago

I had the same problem, xent rapidly decrease to around 80 and stuck here, do you solve the problem?