-
Why does loss multiply by 1024 in the file (5.1_BMInf_CPM.py)?
-
when we run file 'preprocess.py;. the source file(.json) about 2MB was convert to pt file which is need for bert(.pt)about 1KB.why????when we train re-train the pipeline model,it show 0 examples of f…
-
I am trying to reproduce the results by running the given command and this is what I get
Traceback (most recent call last):
File "myTest.py", line 52, in
acc_test = model.evaluate(test, te…
-
bash scripts/ds_finetune_seq2seq.sh config_tasks/model_blocklm_10B_chinese.sh config_tasks/seq_customization.sh
```cmd
.......
using world size: 4 and model-parallel size: 1
> using dynamic lo…
-
Hello,
This might be a stupid question, but i wanted to know if I can use the clustering on German sentences? Will it work with the pre-trained model or do I need to train it on German data first?
…
-
Have you tried the argument of add_new_tokens? I used bert-base-chinese to train my chinese dataset, and the number of entity types exceeds the total [unused], after applying add_marker_tokens functio…
-
hello,
I am building a text generation model in Chinese and trying to pull out the probabilities between words for another task. This is the model I follow : https://www.tensorflow.org/text/tutori…
-
https://github.com/huggingface/transformers/blob/96881729ce83cfc8e5fa04c903ee4296ad17cfbb/src/transformers/models/bert/tokenization_bert.py#L117
Lately, I use bert to train a NER model for Chinese…
-
## ❓ Questions and Help
#### What is your question?
I am training a GPT2-big model on a large dataset (6600M words) on ```NVIDIA V100 32G * 8```. It shows OOM error when training. Any methods f…
-
Seq2SeqSharp is a valid alternative option for .NET Transformer architecture solution.
It seems with a cross platform .NET tokenizer library, especially with **better performance** than those provi…