Open tscheepers opened 3 years ago
Before this change, the EOS was filtered out using np.where(collapsed < (alphabet_size - 1)). This resulted in the line return full_decode[:full_decode.find('>')] not being able to find the end of sentence token.
np.where(collapsed < (alphabet_size - 1))
return full_decode[:full_decode.find('>')]
Before this change, the EOS was filtered out using
np.where(collapsed < (alphabet_size - 1)). This resulted in the linereturn full_decode[:full_decode.find('>')]not being able to find the end of sentence token.