OpenBMB / BMTrain

Efficient Training (including pre-training and fine-tuning) for Big Models
Apache License 2.0
560 stars 77 forks source link

BUG:TypeError: linear(): argument 'input' (position 1) must be Tensor, not NoneType #87

Closed pilipala818 closed 1 year ago

pilipala818 commented 1 year ago

several error occur, when I try to reproduce the project
https://modelcenter.readthedocs.io/en/latest/notes/quickstart.html

1.TypeErrorinit() got an unexpected keyword argument 'architectures' It seems like Hugging face update the configuration file. Problem fixed when I empty configuration file.

2.TypeError: linear(): argument ‘input‘ (position 1) must be Tensor, not NoneType Traceback prompt that it occur from logits = model(input_ids, attention_mask) ... TypeError: linear(): argument ‘input‘ (position 1) must be Tensor, not NoneType return torch._C._nn.linear(input, weight, bias)

Achazwl commented 1 year ago

Seems dataset related bug. Try examples in https://github.com/OpenBMB/ModelCenter/tree/main/examples