meilisearch / charabia

Library used by Meilisearch to tokenize queries and documents

MIT License

261 stars 89 forks source link

Update Lindera to 0.30.0 #279

Closed mosuka closed 7 months ago

mosuka commented 7 months ago

Pull Request

Related issue

265

What does this PR do?

Update Lindera version to 0.30.0. This downloads the dictionary from a GitHub repository, which seems to be more stable.
Optimize built dict.words file size. For unidic, dict.words size is decreased from 200.1MB to 106.3MB.

PR checklist

Please check if your PR fulfills the following requirements:

[x] Does this PR fix an existing issue, or have you listed the changes applied in the PR description (and why they are needed)?
[x] Have you read the contributing guidelines?
[x] Have you made sure that the title is accurate and descriptive of the changes?

Thank you so much for contributing to Meilisearch!

meili-bors[bot] commented 7 months ago

Build succeeded:

tests