-
I used this code and trained with Korean ko-snil data.
adapter_config.json, adapter_model.safetensors, special_tokens_map.json, tokenizer_config.json, tokenizer.json, tokenizer.model
5 files wer…
-
I am very interested in this project. I think it's an interesting project that can create tts with a 10-second voice sample. I also think it's good to support multiple languages. However, there is a p…
-
It appears that BART at least is pretty language agnostic. The English specific parts of NeuroNER (afaict), are the recommended `glove.6B.100d` word vectors, and all of the spacy related tokenizing co…
-
### TensorFlow version
2.17.0
### OS platform and distribution
Google Colab
### Current behavior?
Hi, everyone.
I am practicing implementing a Transformer model that machine translat…
-
Hi, I noticed from #12328 that spaCy has switched to `pymecab-ko` for the Korean tokenizer in the upcoming `spaCy` 4.0, but there seems to be some installation/import issues of this package on macOSes…
-
Hello there. I'm a big fan of your plugin, is there any chance you could add Korean language to the functionality of this plugin? As a Korean user, I would be very happy to use it if you do.
-
Is it possible to use a different tokenizer with multiple language support for the Donut processor? like mbart tokenizer in the Donut processor instead of xlmrobertafast
@NielsRogge
-
### Question Validation
- [X] I have searched both the documentation and discord for an answer.
### Question
I don't use huggingface because of proxy issue. So, I tried to make local embeddin…
-
#31 identified a tokenizer error with Chinese due to a missing dependency.
Spacy documentation lists additional dependencies for a number of languages at https://spacy.io/usage/models#languages:
…
-
It's so great that RediSearch could be another choice for full-text search since i am an Elasticsearch fans and a search engineer for almost ten years.
I am the author of [Friso](https://github.com…