search

daniel-kukiela / nmt-chatbot

NMT Chatbot
GNU General Public License v3.0
385 stars 213 forks source link

Bleu_rate 0.00 #120

Closed danielissac closed 5 years ago

danielissac commented 5 years ago

Bleu_rate is still 0.00 even after the global step 2000 is that normal? Should I restart? I've changed the batch size from 128 to 64 and set the override_loaded_hparams = True.

andrewdoud commented 4 years ago

Hi there, have been having this problem as well, did you figure out a way to solve this issue? My bleu has been zero for 70k steps.

andrewdoud commented 4 years ago

I found in separate threads that:

  1. Many people's bleu scores don't go up until after ~100k steps
  2. When training a massive set of data bleu will often be very low because of high variance in responses, and thus is not actually that important of a metric.