brightmart albert_zh issues

brightmart / albert_zh

A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型

https://arxiv.org/pdf/1909.11942.pdf

3.92k stars 755 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Internal: Blas GEMM launch failed : a.shape=(4096, 128), b.shape=(128, 312), m=4096, n=312, k=128

#178 wzhslap opened 11 months ago
0
AttributeError: module 'tensorflow.contrib.tpu' has no attribute 'InputPipelineConfig'

#177 wzhslap opened 1 year ago
0
File path error

#176 w17716383006 opened 1 year ago
0
在预训练生成特定格式的文件(tfrecords) 时内存不足问题

#173 TITONIChen opened 1 year ago
1
有相关onnx模型转换与调用的支持嘛？

#172 Gmgge opened 2 years ago
0
预训练的差异

#171 447428054 opened 2 years ago
1
想請問模型的 license

#170 emfomy closed 1 year ago
0
请问DataProcessor类在哪里呢

#169 sweetboxwwy opened 2 years ago
0
数据集下载不了

#168 sweetboxwwy closed 2 years ago
1
whats the difference between `albert_tiny_zh` and `albert_tiny_google_zh`

#167 zheyuye opened 2 years ago
1
请问预训练模型是文本分类模型吗? 想做语言模型，预测下一个单字或词应该怎么修改？

#166 JiaoPaner closed 2 years ago
0
请问中文albert训练过程中是按字符级分割还是按词语级分割？

#165 rsindper opened 2 years ago
1
求助

#164 xiaoxiao111111 closed 2 years ago
2
'str' object has no attribute 'size'

#163 wenHK closed 2 years ago
1
模型转换pytorch问题

#162 dalinvip opened 3 years ago
5
预训练语料构造问题

#161 mwei314 opened 3 years ago
0
句向量特征提取的最佳实践

#160 RingoD opened 3 years ago
0
The exact English pretraining data and Chinese pretraining data that are exact same to the BERT paper's pretraining data.

#159 guotong1988 opened 3 years ago
0
请问考虑将模型发布到 tfhub 上面吗？

#158 HarborZeng opened 3 years ago
0
有兄弟试过 iflytek 数据训练出的分类模型吗？albert_tiny 模型进行下游任务，得到的结果比较郁闷。

#157 commissarster opened 3 years ago
0
how to load albert_zh model

#156 lijiekiff opened 3 years ago
0
文件不存在呀

#155 taroyutao closed 3 years ago
0
打算训一个更小的预训练模型，你们预训练数据都是咋准备的啊？

#154 TriLoo opened 3 years ago
1
albert_Tiny文本分类推理速度CPU 300+ms，GPU 7ms，请问正常么

#153 faker2cumtb opened 3 years ago
0
xxlarge模型微调时训不动

#152 bestbzw opened 3 years ago
0
使用transformers无法加载模型

#151 Brokenwind opened 3 years ago
0
这个pretrain用的tensorflow版本是什么？

#150 yangtianyu92 opened 3 years ago
1
albert_chinese_large 报显存错误

#149 teng1996 opened 3 years ago
1
HTTP request sent, awaiting response... 404 Not Found; https://raw.githubusercontent.com/pengming617/text_matching/master/data/test.txt

#148 king21guns opened 3 years ago
1
请问下，我想在 albert_zh 后面拼接上一个ctc loss 的输出，能实现么？

#147 x19990416 opened 3 years ago
1
执行预训练 pre-training on GPU/TPU using the command.训练tiny模型

#146 gaojingqian opened 3 years ago
0
run_classifier_clue.sh 这个脚本好像没有下载下来数据，https://storage.googleapis.com这个网址也打不开

#145 starplatinum3 opened 3 years ago
2
在run_classifier里加载模型正确，在run_pretraining_google.py里加载模型报错：ValueError: Shape of variable bert/embeddings/LayerNorm/beta:0 ((128,)) doesn't match with shape of tensor bert/embeddings/LayerNorm/beta ([312]) from checkpoint reader.

#144 yuanjun1991 opened 3 years ago
1
预训练的中文预料除了wiki还有啥

#143 ann22 opened 4 years ago
0
tpu 名称

#142 chinese-wikisource opened 4 years ago
0
tflite 模型转换出现问题tflite Check failed: axis < input_shape.dimensions count()

#141 LLLLLLoki opened 4 years ago
0
训练集一万多条数据，测试集两千多条，共400多类，训练集准确率90%多，验证集70%，这正常吗

#140 ann22 opened 4 years ago
1
用run_classifier_clue.py跑分类任务，Adam优化时，梯度出现Nan

#139 jcfeng opened 4 years ago
0
加载albert_base和albert_large准确率正常，80%多，但加载albert_xlarge准确率约等于零，请问大神们这是怎么回事，同一数据集

#138 ann22 closed 4 years ago
2
ValueError: Shape of variable bert/embeddings/LayerNorm/beta:0 ((312,)) doesn't match with shape of tensor bert/embeddings/LayerNorm/beta ([128]) from checkpoint reader

#137 BrightHai opened 4 years ago
3
Windows fatal exception: access violation

#136 kezoy opened 4 years ago
0
ALBERT-small训练效果问题

#135 Hanlard opened 4 years ago
1
Albert_zh 和Google Albert的几点区别

#134 jiezouguihuafu opened 4 years ago
2
关于Factorized Embedding Parameterization的问题

#133 hntee closed 4 years ago
4
加载使用albert base正常，加载albert tiny or small报错

#132 sataliulan closed 3 years ago
1
直接运行Similarity.py报错，模型restore失败

#131 justein opened 4 years ago
0
Update README.md

#130 guotong1988 opened 4 years ago
0
请问怎么转化成pb文件，输入层和输出层是什么呢

#129 KatouMegumiMoe opened 4 years ago
4
tf2.0适配

#128 2012060010010 opened 4 years ago
0
做预训练 Pre-training时关于do-eval疑问

#127 WuSiQingChun closed 4 years ago
0