Hedera-Lang-Learn / hedera

MIT License
10 stars 2 forks source link

Editor: editing a word with punctuation after it will add a space before the punctuation #516

Open bilbe opened 1 year ago

bilbe commented 1 year ago

editing a word with punctuation after it will add a space before the punctuation, e.g, "advenio." will become "advenio ."

jaguillette commented 1 year ago

We found that the space is being added in parsers.py when a chunk is being lemmatized. In the lemmatize function, there is a space added when tokenizing