-
### System Info
- `transformers` version: 4.40.0.dev0
- Platform: macOS-14.1-arm64-arm-64bit
- Python version: 3.10.0
- Huggingface_hub version: 0.22.0
- Safetensors version: 0.4.2
- Accelerate …
-
In this step, we address the challenge of incorporating underrepresented languages with a focus on low-resource languages. This effort confronts the prevalent imbalance in NLP systems, which are predo…
-
I am currently experimenting with a scalable approach for retrieval and reranking benchmark dataset creation based on the `wikimedia/wikipedia` HF datasets. I want to specifically target this at mid a…
-
Just get all language codes and names, and make sure the codes we already have are actually valid.
### 1. Add more languages
e.g. `ltg` for Latgalian
- https://www.reddit.com/r/machinetranslation…
-
https://www.aclweb.org/anthology/2020.acl-srw.22.pdf
-
Any thoughts on fine-tuning from Whisper for low-resource Indian languages.
I can contribute if there's a concerted effort on hits.
Thank you
-
# Welcome to the Common Voice Community !
> Common Voice aims to make speech technology accessible to everyone by building an open sourced dataset of labelled voice data that is representative of l…
-
In the short term we are focusing on building up our language list by training easy to segment LTR languages, as they don't require changes to the training pipeline, and are immediately supported in F…
-
### Feature request
MAML is a widely used meta-learning method for reinitializing model parameters, which can effectively cope with low-resource situations.
As Whisper is a pre-trained model, its pa…
-
**Background**
In the field of multilingual large models, especially for non-English corpora, there is often a problem of insufficient data quantity and poor quality. High-quality training data is cr…