-
文中提到因为预训练没有使用NSP任务而忽略了segment embedding,为什么源码`fusion_embedding.py`里还是出现了`token_type_embeddings`,虽然是用0初始化的
https://github.com/ShannonAI/ChineseBert/blob/53d9c25d664ce19849b369b8ef47ea3ea0d9029a/mode…
-
在跑chinesebert 时出现这个问题是什么原因呀?
loading data ...
The tokenizer class you load from this checkpoint is not the same type as the class this function is called from. It may result in unexpected tokenizati…
ghost updated
2 years ago
-
-
请问您对ChineseBERT进行预训练过嘛?还是只是复现了finetune部分的结果?
-
我想请问一下,在运行tasks中的LCQMC示例的时候,如果没有GPU该如何调整
python LCQMC_trainer.py --bert_path ../ChineseBERT-base/ --data_dir E:/PycharmProjects/ChineseBert/lcqmc/ --save_path ../../cus_output/ --max_epoch=7 --lr…
-
-
如何调用large模型呢?是不是改一下config.json就行了呢?
需要将将config.json中的哪些部分进行修改呢
-
Thank you for your sharing about MLM works!
I have tried chatting with "Lion"-Bot while asking in Chinese, and got brief answer almost in English.
But I'm appreciated to know why using **chineseBERT…
-
Please check the requirement.txt to make sure you install the right version
_Originally posted by @zijunsun in https://github.com/ShannonAI/ChineseBert/issues/18#issuecomment-895709627_
-
在运行ChnSetiCorp.py时,报错: Failed to interpret file 'ChineseBERT-base\\config\\._STFANGSO.TTF24.npy' as a pickle
请问这种问题该如何解决,在网上也没有找到答案.