-
HI! How did you set the parameters of the make_dict.py in your experiments? There was no mention of vocab in the previous process. FileNotFoundError: [Errno 2] No such file or directory: 'vocab'
-
When the UNTP publishes schema or vocabs, this library should import those by default to avoid required an unanchored vocab value.
Jsyro updated
2 weeks ago
-
**Describe the bug**
Using torch 2.1.1, running bash examples/bert/train_bert_340m_distributed.sh produces JIT error due to the Sequence annotator in `calculate_logits_max`
```
return torch.jit.scr…
-
I was studying for the upcoming JLPT exam this week, and noticed that only kanji are coming up in advanced search.
I don't know if this is a known bug or just something on my end, but I figured I'd l…
-
http://vocab.belgif.be/ns/other#CbeRegisteredEntity IRIis not needed, W3C ROV can be used (rov:RegisteredOrganization)
http://vocab.belgif.be/ns/other#EstablishmentUnit IRI is not needed, W3C ORG c…
-
I can load the model using below code:
```
from transformers import AutoModelForCausalLM, AutoTokenizer
model_id = "/root/private_data/models/Meta-Llama-3.1-70B-Instruct"
model = AutoModelForC…
-
What if the "Consult the DVL" page were just one page with language options? Could just make tables out of whatever data it gets back.
-
For tokenizers in `transformers`, in convention, `tokenizer.vocab_size` [as documented](https://github.com/huggingface/transformers/blob/092f1fdaa4224fdd88c616dc9678e6fcb37bfffd/src/tran…
-
By limited by VRAM, I'm using unsloth to finetuned Qwen2 by following the notebook(https://colab.research.google.com/drive/1mvwsIQWDs2EdZxZQF9pRGnnOvE86MVvR?usp=sharing).
But I got these warnings f…
-
请问你是怎么解决“def build_vocabulary(spacy_de, spacy_en):
def tokenize_de(text):
return tokenize(text, spacy_de)
def tokenize_en(text):
return tokenize(text, spacy_en)
pr…