Directory based config

[10zinten]

Questions

• [ ] no file starts with lexica https://github.com/Esukhia/botok/blob/b5cd49c2e7e6ccff2ef125d65d0c202a658de253/botok/tries/trie.py#L71
• [ ] Where is particles.tsv and other data in resources directory ?

[ngawangtrinley]

Lexica was replaced by words

Particles was in main I think

[10zinten]

@ngawangtrinley I have put all the dialect packs in botok-data and released each dialect like that

Then we just have to pass the dialect name like so https://github.com/Esukhia/botok/blob/709b6c4a78b5a67fb60148a0c31ad94c88b25e80/tests/test_config.py#L38 and config will automatically download the latest release of the dialect pack if not downloaded and initialize the config.

Config can also be created directory path of the dialect pack https://github.com/Esukhia/botok/blob/5d217106403c99e5b9ff039d87e5693b8ee574b2/tests/test_config.py#L54

How is it ?