[PR] Add multi-text corpus analysis

HarikalarKutusu / cv-tbox-dataset-compiler

GNU Affero General Public License v3.0

0 stars 0 forks source link

Closed HarikalarKutusu closed 9 months ago

HarikalarKutusu commented 9 months ago

Using git commit dates, goes back and gets text-corpora analysis per language version
Start to use external cache/clone for this & not to hit the API extensively
Change directory creation
Add some global statistics (not final)
Add grapheme & phoneme counts to records

PS: Changes already adapted in Analyzer v0.13.0 release