search

marian-nmt / marian-regression-tests

Regression tests for the marian-dev repository
Other
4 stars 9 forks source link

Tests for encodeWithByteRanges #76

Closed jerinphilip closed 3 years ago

jerinphilip commented 3 years ago

encodeWithByteRanges tries to additionally provide string_views corresponding to the sourcetokens where the words came from. To assert this works, the following method is used:

The alignments provided by encodeWithByteRanges should match the intended tokens in the input. The expected tokens are provided as .expected while the output is generated through encodeWithByteRanges's alignments.

jerinphilip commented 3 years ago

Nevermind, GitHub default button put me here. Closing myself.