-
The samples in Korean is impressive. wanna have some experiments on madrain dataset, does there any instructions on training on another language?
-
-
-
I have pretrained an albert using my own data(chinese language), then I wanted to use this pretained model into downstream tasks, but I got this error when I load my pre trained Albert file. I guess i…
-
Hi,
I'm trying using your "langvar" branch to translate from Chinese to English, but I got strange statistic and result.
Statistic:
```
[2021-09-01 14:16:18,792 INFO] Step 50/150000; acc: 83…
-
执行后加载模型报错
(chatglm_openapi_api) root@lab:/data/app/chatglm-openai-api# python main.py --port 8080 --llm_model chatglm-6b-int4 --embeddings_model text2vec-large-chinese --tunnel ngrok
>> Use chatg…
-
我自己找到Bert模型报了错误,所以请教一下预训练模型bert是哪个啊?
![image](https://user-images.githubusercontent.com/31085549/190887344-5ccf6d1a-a3e3-4987-b2df-106eb5262503.png)
-
```
python create_pretraining_data.py \
--input_file=./chinese_sample_text.txt \
--output_file=/tmp/tf_examples.tfrecord \
--vocab_file=bert_checkpoint/vocab.txt \
--do_lower_case=True \
…
-
作者你好,
我在尝试使用change_mp.py将checkpoint拆分之后使用模型并行,但是在加载模型时提示word embedding大小不匹配。读过代码之后发现代码会在加载模型时将词表大小pad到某个数的整数倍(以提高计算效率),这个数是`args.make_vocab_size_divisible_by * mpu.get_model_parallel_world_size()`,…
-
C++ 代码
lm::ngram::Config config;
model = new lm::ngram::Model(language_model_path);
初始话C++ 版本的 kenlm 模型报错
相同代码时而能成功 ,但常时间下是报错的
Segmentation fault (core dumped)
段错误 可能是哪儿指针存在问题,求大神救救我