In this pull request, there are several things included:
Implementing new Lookup-table data structure. (Named Finite State Machine (FSM) because it behaves like FSM). This data structure is able to lookup general rules such as rule for 2 or more adjacent non terminals.
Speed-up lookuptable loading. This is done by changing the way in checking whether rule is balance or not (have same non terminals in source and target).
Fix bug travatar config help didn't print the correct configuration.
Support -in_format "word" and tm_storage "fsm" are automatically written if the model is trained with -method hiero
Some Refactor such as removing unnecessary include and some format fix.
This pull request does not include the reading of the new discussed travatar's model. So up-to this pull request, the old model can still work.
In this pull request, there are several things included:
This pull request does not include the reading of the new discussed travatar's model. So up-to this pull request, the old model can still work.
Philip