search

leehanchung / lora-instruct

Finetune Falcon, LLaMA, MPT, and RedPajama on consumer hardware using PEFT LoRA
Apache License 2.0
102 stars 13 forks source link

Error message when training MPT-7B #7

Open jianchaoji opened 1 year ago

jianchaoji commented 1 year ago

Hi I got a message when I try to use Lora to train MPT-B, do you have any ideas to solve it?

ValueError: Unable to create tensor, you should probably activate truncation and/or padding with 'padding=True' 'truncation=True' to have batched tensors with the same length. Perhaps your features (instruction in this case) have excessive nesting (inputs type list where type int is expected).

benam2 commented 1 year ago

Hi @jianchaoji Were able to fine tune MPT model?

jianchaoji commented 1 year ago

I'm afraid not.