search

PaddlePaddle / PaddleHub

Awesome pre-trained models toolkit based on PaddlePaddle. (400+ models including Image, Text, Audio, Video and Cross-Modal with Easy Inference & Serving)
https://www.paddlepaddle.org.cn/hub
Apache License 2.0
12.66k stars 2.07k forks source link

单机rtx3060 跑ERNIE，paddl和cuda换好多版本 都不行 #1529

Open yslion opened 3 years ago

yslion commented 3 years ago

https://aistudio.baidu.com/aistudio/projectdetail/1049443?channelType=0&channel=0

paddlepaddle-gpu==2.1.1.post110 cuda=11.0

fluid.install_check.run_check() 能过得去 ，但是执行具体代码

module = hub.Module(name="ernie_gen")

result = module.finetune(
    train_path='leave.txt',
    save_dir="ernie_param",
)
#os.environ["CUDA_VISIBLE_DEVICES"] = '0'
#device = paddle.set_device('gpu')
# 将训练参数打包为hub model
module.export(params_path=result['last_save_path'], module_name="ernie_leave", author="")

报这个： ValueError: (InvalidArgument) Tensor holds the wrong type, it holds int, but desires to be int64_t.

D:\venv36\paddle\lib\site-packages\setuptools\depends.py:2: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
  import imp
[2021-07-13 19:49:49,220] [    INFO] - Found C:\Users\yslio\.paddlenlp\models\ernie-1.0\vocab.txt
[2021-07-13 19:49:49,234] [    INFO] - Already cached C:\Users\yslio\.paddlenlp\models\ernie-1.0\ernie_v1_chn_base.pdparams
[2021-07-13 19:49:49,237] [   DEBUG] - init ErnieModel with config: {'attention_probs_dropout_prob': 0.1, 'hidden_act': 'relu', 'hidden_dropout_prob': 0.1, 'hidden_size': 768, 'initializer_range': 0.02, 'max_position_embeddings': 513, 'num_attention_heads': 12, 'num_hidden_layers': 12, 'type_vocab_size': 2, 'vocab_size': 18000, 'pad_token_id': 0}
W0713 19:49:49.238672 21400 device_context.cc:404] Please NOTE: device: 0, GPU Compute Capability: 8.6, Driver API Version: 11.1, Runtime API Version: 11.0
W0713 19:49:49.245651 21400 device_context.cc:422] device: 0, cuDNN Version: 8.0.
[2021-07-13 19:49:53,050] [    INFO] - loading pretrained model from C:\Users\yslio\.paddlenlp\models\ernie-1.0\ernie_v1_chn_base.pdparams
[2021-07-13 19:49:53,674] [    INFO] - param:mlm_bias not set in pretrained model, skip
[2021-07-13 19:49:53,676] [    INFO] - param:mlm.weight not set in pretrained model, skip
[2021-07-13 19:49:53,677] [    INFO] - param:mlm.bias not set in pretrained model, skip
[2021-07-13 19:49:53,677] [    INFO] - param:mlm_ln.weight not set in pretrained model, skip
[2021-07-13 19:49:53,677] [    INFO] - param:mlm_ln.bias not set in pretrained model, skip
Traceback (most recent call last):
  File "1.py", line 13, in <module>
    save_dir="ernie_param",
  File "D:\venv36\paddle\lib\site-packages\paddlehub\compat\paddle_utils.py", line 220, in runner
    return func(*args, **kwargs)
  File "C:\Users\yslio\.paddlehub\modules\ernie_gen\module.py", line 183, in finetune
    mask_tgt_2_srctgt, mask_attn_2_srctgtattn, tgt_labels, tgt_pos)
  File "D:\venv36\paddle\lib\site-packages\paddle\fluid\dygraph\layers.py", line 902, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "C:\Users\yslio\.paddlehub\modules\ernie_gen\model.py", line 48, in forward
    tgt_pos=tgt_pos)
  File "D:\venv36\paddle\lib\site-packages\paddle\fluid\dygraph\layers.py", line 902, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "D:\venv36\paddle\lib\site-packages\paddlenlp\transformers\ernie_gen\modeling.py", line 614, in forward
    soft_label=(tgt_labels.shape[-1] != 1))
  File "D:\venv36\paddle\lib\site-packages\paddle\nn\functional\loss.py", line 1392, in cross_entropy
    'use_softmax', use_softmax)
ValueError: (InvalidArgument) Tensor holds the wrong type, it holds int, but desires to be int64_t.
  [Hint: Expected valid == true, but received valid:0 != true:1.] (at C:\home\workspace\Paddle_release1\paddle/fluid/framework/tensor_impl.h:33)
  [operator < softmax_with_cross_entropy > error]

换成 paddlepaddle-gpu==2.1.1.post101 cuda=10.1

fluid.install_check.run_check() 就一直卡在这 几十分钟不动

D:\venv36\paddle\lib\site-packages\setuptools\depends.py:2: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
  import imp
Running Verify Fluid Program ...
W0713 19:48:13.684360 20632 device_context.cc:404] Please NOTE: device: 0, GPU Compute Capability: 8.6, Driver API Version: 11.1, Runtime API Version: 11.0
W0713 19:48:13.747206 20632 device_context.cc:422] device: 0, cuDNN Version: 8.0.
paddle-bot-old[bot] commented 3 years ago

您好，我们已经收到了您的问题，会安排技术人员尽快解答您的问题，请耐心等待。请您再次检查是否提供了清晰的问题描述、复现代码、环境&版本、报错信息等。同时，您也可以通过查看官网API文档、常见问题、历史Issue、AI社区来寻求解答。祝您生活愉快～

Hi! We've received your issue and please be patient to get responded. We will arrange technicians to answer your questions as soon as possible. Please make sure that you have posted enough message to demo your request. You may also check out the API，FAQ，Github Issue and AI community to get the answer.Have a nice day!

yslion commented 3 years ago

如何了 兄弟们

yslion commented 3 years ago

@nepeplwu @yinhaofeng @BurrowsWang @ZeyuChen

KPatr1ck commented 3 years ago

D:\venv36\paddle\lib\site-packages\setuptools\depends.py:2: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses import imp [2021-07-13 19:49:49,220] [ INFO] - Found C:\Users\yslio.paddlenlp\models\ernie-1.0\vocab.txt [2021-07-13 19:49:49,234] [ INFO] - Already cached C:\Users\yslio.paddlenlp\models\ernie-1.0\ernie_v1_chn_base.pdparams [2021-07-13 19:49:49,237] [ DEBUG] - init ErnieModel with config: {'attention_probs_dropout_prob': 0.1, 'hidden_act': 'relu', 'hidden_dropout_prob': 0.1, 'hidden_size': 768, 'initializer_range': 0.02, 'max_position_embeddings': 513, 'num_attention_heads': 12, 'num_hidden_layers': 12, 'type_vocab_size': 2, 'vocab_size': 18000, 'pad_token_id': 0} W0713 19:49:49.238672 21400 device_context.cc:404] Please NOTE: device: 0, GPU Compute Capability: 8.6, Driver API Version: 11.1, Runtime API Version: 11.0 W0713 19:49:49.245651 21400 device_context.cc:422] device: 0, cuDNN Version: 8.0. [2021-07-13 19:49:53,050] [ INFO] - loading pretrained model from C:\Users\yslio.paddlenlp\models\ernie-1.0\ernie_v1_chn_base.pdparams [2021-07-13 19:49:53,674] [ INFO] - param:mlm_bias not set in pretrained model, skip [2021-07-13 19:49:53,676] [ INFO] - param:mlm.weight not set in pretrained model, skip [2021-07-13 19:49:53,677] [ INFO] - param:mlm.bias not set in pretrained model, skip [2021-07-13 19:49:53,677] [ INFO] - param:mlm_ln.weight not set in pretrained model, skip [2021-07-13 19:49:53,677] [ INFO] - param:mlm_ln.bias not set in pretrained model, skip Traceback (most recent call last): File "1.py", line 13, in save_dir="ernie_param", File "D:\venv36\paddle\lib\site-packages\paddlehub\compat\paddle_utils.py", line 220, in runner return func(*args, kwargs) File "C:\Users\yslio.paddlehub\modules\ernie_gen\module.py", line 183, in finetune mask_tgt_2_srctgt, mask_attn_2_srctgtattn, tgt_labels, tgt_pos) File "D:\venv36\paddle\lib\site-packages\paddle\fluid\dygraph\layers.py", line 902, in call outputs = self.forward(*inputs, *kwargs) File "C:\Users\yslio.paddlehub\modules\ernie_gen\model.py", line 48, in forward tgt_pos=tgt_pos) File "D:\venv36\paddle\lib\site-packages\paddle\fluid\dygraph\layers.py", line 902, in call outputs = self.forward(inputs, kwargs) File "D:\venv36\paddle\lib\site-packages\paddlenlp\transformers\ernie_gen\modeling.py", line 614, in forward soft_label=(tgt_labels.shape[-1] != 1)) File "D:\venv36\paddle\lib\site-packages\paddle\nn\functional\loss.py", line 1392, in cross_entropy 'use_softmax', use_softmax) ValueError: (InvalidArgument) Tensor holds the wrong type, it holds int, but desires to be int64_t. [Hint: Expected valid == true, but received valid:0 != true:1.] (at C:\home\workspace\Paddle_release1\paddle/fluid/framework/tensor_impl.h:33) [operator < softmax_with_cross_entropy > error]

感谢反馈，问题已经修复，请重新安装测试：hub install ernie_gen

yslion commented 3 years ago

D:\venv36\paddle\lib\site-packages\setuptools\depends.py:2: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses import imp [2021-07-13 19:49:49,220] [ INFO] - Found C:\Users\yslio.paddlenlp\models\ernie-1.0\vocab.txt [2021-07-13 19:49:49,234] [ INFO] - Already cached C:\Users\yslio.paddlenlp\models\ernie-1.0\ernie_v1_chn_base.pdparams [2021-07-13 19:49:49,237] [ DEBUG] - init ErnieModel with config: {'attention_probs_dropout_prob': 0.1, 'hidden_act': 'relu', 'hidden_dropout_prob': 0.1, 'hidden_size': 768, 'initializer_range': 0.02, 'max_position_embeddings': 513, 'num_attention_heads': 12, 'num_hidden_layers': 12, 'type_vocab_size': 2, 'vocab_size': 18000, 'pad_token_id': 0} W0713 19:49:49.238672 21400 device_context.cc:404] Please NOTE: device: 0, GPU Compute Capability: 8.6, Driver API Version: 11.1, Runtime API Version: 11.0 W0713 19:49:49.245651 21400 device_context.cc:422] device: 0, cuDNN Version: 8.0. [2021-07-13 19:49:53,050] [ INFO] - loading pretrained model from C:\Users\yslio.paddlenlp\models\ernie-1.0\ernie_v1_chn_base.pdparams [2021-07-13 19:49:53,674] [ INFO] - param:mlm_bias not set in pretrained model, skip [2021-07-13 19:49:53,676] [ INFO] - param:mlm.weight not set in pretrained model, skip [2021-07-13 19:49:53,677] [ INFO] - param:mlm.bias not set in pretrained model, skip [2021-07-13 19:49:53,677] [ INFO] - param:mlm_ln.weight not set in pretrained model, skip [2021-07-13 19:49:53,677] [ INFO] - param:mlm_ln.bias not set in pretrained model, skip Traceback (most recent call last): File "1.py", line 13, in save_dir="ernie_param", File "D:\venv36\paddle\lib\site-packages\paddlehub\compat\paddle_utils.py", line 220, in runner return func(*args, kwargs) File "C:\Users\yslio.paddlehub\modules\ernie_gen\module.py", line 183, in finetune mask_tgt_2_srctgt, mask_attn_2_srctgtattn, tgt_labels, tgt_pos) File "D:\venv36\paddle\lib\site-packages\paddle\fluid\dygraph\layers.py", line 902, in call outputs = self.forward(*inputs, kwargs) File "C:\Users\yslio.paddlehub\modules\ernie_gen\model.py", line 48, in forward tgt_pos=tgt_pos) File "D:\venv36\paddle\lib\site-packages\paddle\fluid\dygraph\layers.py", line 902, in call* outputs = self.forward(inputs, kwargs) File "D:\venv36\paddle\lib\site-packages\paddlenlp\transformers\ernie_gen\modeling.py", line 614, in forward soft_label=(tgt_labels.shape[-1] != 1)) File "D:\venv36\paddle\lib\site-packages\paddle\nn\functional\loss.py", line 1392, in cross_entropy 'use_softmax', use_softmax) ValueError: (InvalidArgument) Tensor holds the wrong type, it holds int, but desires to be int64_t. [Hint: Expected valid == true, but received valid:0 != true:1.] (at C:\home\workspace\Paddle_release1\paddle/fluid/framework/tensor_impl.h:33) [operator < softmax_with_cross_entropy > error]

感谢反馈，问题已经修复，请重新安装测试：hub install ernie_gen

那我该用cuda 10.1 还是cuda 11.0 ?