-
Until today (10.05.17) the analyzer (tokeniser-disamb-gt-desc.pmhfst) produced output containing word forms and their morphological analysis. Then the output changed to the following:
```
$ echo "о…
ulp16 updated
5 years ago
-
Possible collaboration with a project aiming to tokenise commodities.
-
# Lines of code
https://github.com/code-423n4/2023-08-goodentry/blob/4b785d455fff04629d8675f21ef1d1632749b252/contracts/TokenisableRange.sol#L85-L120
https://github.com/code-423n4/2023-08-goodentry/b…
-
Does the sentence pairs need to be tokenised before using the Invitation Model?
-
Comments are tokenised but skipped over in graph generation.
Want a way to display them alongside the graph, ideally as an aside branched from the (nearest?) node
 as example):
```sh
echo 'Jođiheaddji guovttosges' | hfst-tokenise -g tokeniser-gramcheck-gt-desc.pmhfst
""
"ge…
-
**Issue Description:**
While attempting to reproduce the findings in your preprint, I'm encountering an error running the tokenise_bio.py script on large (3GB or larger) FASTA files, including the GC…
-