search

brightmart / albert_zh

A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型
https://arxiv.org/pdf/1909.11942.pdf
3.93k stars 754 forks source link

word_embeddings dim问题 #86

Open Fakekid opened 4 years ago

Fakekid commented 4 years ago

加载albert-base模型时报以下错误： Shape of variable bert/embeddings/word_embeddings:0 ((21128, 768)) doesn't match with shape of tensor bert/embeddings/word_embeddings ([21128, 128]) from checkpoint reader.

Vimos commented 4 years ago

可能属于重复问题，参考 https://github.com/brightmart/albert_zh/issues/17

charlesXu86 commented 4 years ago

加载albert-base模型时报以下错误： Shape of variable bert/embeddings/word_embeddings:0 ((21128, 768)) doesn't match with shape of tensor bert/embeddings/word_embeddings ([21128, 128]) from checkpoint reader.

你的问题解决了吗