Print the first </s> in the preview.

ufal / neuralmonkey

An open-source tool for sequence learning in NLP built on TensorFlow.

BSD 3-Clause "New" or "Revised" License

410 stars 104 forks source link

Open jindrahelcl opened 5 years ago

jindrahelcl commented 5 years ago

We'd like to see e.g. this:

output_fw: ▁The </s> ▁ ▁ ▁ </s> ▁ ▁ s </s>

where the last </s>is the first of </s>-only tokens (or <pad>)