Build a language detector with FastC - Githubissues

EveripediaNetwork / issues

Issues repo

9 stars 0 forks source link

Build a language detector with FastC #2766

Closed Softdev1 closed 2 weeks ago

Softdev1 commented 2 weeks ago

Description

Create a fastc model to detect text languages.

brunneis commented 2 weeks ago

New HuggingFace collection for Language Detection: https://huggingface.co/collections/braindao/language-identification-6669eafebbbc97e3c0f67e46

brunneis commented 2 weeks ago

Lightweight model with great accuracy for English, Spanish, Korean and Chinese: https://huggingface.co/braindao/tinyroberta-6l-768d-language-identifier-en-es-ko-zh-fastc

brunneis commented 2 weeks ago

Train / eval scripts: https://github.com/EveripediaNetwork/language-identification-fastc