Open jindrahelcl opened 5 years ago
We'd like to see e.g. this:
output_fw: ▁The </s> ▁ ▁ ▁ </s> ▁ ▁ s </s>
where the last </s>is the first of </s>-only tokens (or <pad>)
</s>
<pad>
We'd like to see e.g. this:
output_fw: ▁The </s> ▁ ▁ ▁ </s> ▁ ▁ s </s>
where the last
</s>
is the first of</s>
-only tokens (or<pad>
)