search

jiangxinyang227 / NLP-Project

including text classifier, language model, pre_trained model, multi_label classifier, text generator, dialogue. etc
469 stars 224 forks source link

transformer训练准确度低 #18

Open Augus753 opened 4 years ago

Augus753 commented 4 years ago

你好。很感谢您提供的代码教程。目前发现transformer训练准确度低。只有不到60%，大大低于TextCNN的85%，请问您当时测试也是如此吗？若是提高，可以给点建议吗？谢谢 text_classifier/models/transformer.py

VerusHao commented 4 years ago

transformer训练过程最后维度归一化时矩阵相乘维度出错，你改了什么地方吗

wuxi-xc commented 2 years ago

请问transformer在进行中文二分类时运行test.py出现InvalidArgumentError (see above for traceback): Inputs to operation transformer/transformer-1/multi_head_atten/Select of type Select must have the same size and shape. Input 0: [8,150,150] != input 1: [240,150,150]错误是什么原因了谢谢

wuxi-xc commented 2 years ago

您好，请问您在运行test.py时会出现错误吗，求解急