search

MycroftAI / lingua-franca

Mycroft's multilingual text parsing and formatting library
Apache License 2.0
75 stars 78 forks source link

numbers_to_digits doesn't handle empty token list #162

Open ChanceNCounter opened 3 years ago

ChanceNCounter commented 3 years ago

Bug revealed by mismatch between Mycroft and a fallback skill's configured languages:

    return CatalanNormalizer().normalize(text, remove_articles)
  File "/home/jmontane/mycroft-core/.venv/lib/python3.7/site-packages/lingua_franca/lang/parse_common.py", line 172, in normalize
    utterance = self.numbers_to_digits(utterance)
  File "/home/jmontane/mycroft-core/.venv/lib/python3.7/site-packages/lingua_franca/lang/parse_common.py", line 119, in numbers_to_digits
    words = self.tokenize(utterance)
  File "/home/jmontane/mycroft-core/.venv/lib/python3.7/site-packages/lingua_franca/lang/parse_ca.py", line 252, in tokenize
    if tokens[-1] == '-':
IndexError: list index out of range

(reported by jmontane in Mattermost)

JarbasAl commented 3 years ago

not related to any mismatch

image