jtrmal
commented
4 years ago are you sure you want filter out/check for duplicate strings? I'm not sure if there would be a problem in general, as most of the kaldi cares about the indices only... Not sure -- just asking. y.
On Fri, Nov 20, 2020 at 4:54 AM kkm000 notifications@github.com wrote:
The message from an FST binary doesn't clearly point to the cause. An easy fix, I'll do.
The tool also trusts the index value of #0 being 1 larger than the last phone symbol, which better be checked. We generally try to validate everything user-supplied as much as possible.
I'm thinking of adding a utility script to validate FST symbol tables in general, to make sure a file does not contain duplicate strings or duplicate indexes, that 0 is
and so on. There are a couple places where a more thorough check is done, a couple other where it's half-done, and this one does not do much checking at all. — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/kaldi-asr/kaldi/issues/4344, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACUKYX553IWBT3CDA7CF5VTSQY4GZANCNFSM4T4RWKGA .
danpovey
kkm000
The message from an FST binary doesn't clearly point to the cause. An easy fix, I'll do.
The tool also trusts the index value of
#0being 1 larger than the last phone symbol, which better be checked. We generally try to validate everything user-supplied as much as possible.I'm thinking of adding a utility script to validate FST symbol tables in general, to make sure a file does not contain duplicate strings or duplicate indexes, that 0 is
<eps>and so on. There are a couple places where a more thorough check is done, a couple other where it's half-done, and this one does not do much checking at all.