TensorParallel object has no attribute save_pretrained

BlackSamorez / tensor_parallel

Automatically split your PyTorch models on multiple GPUs for training & inference

MIT License

629 stars 39 forks source link

TensorParallel object has no attribute save_pretrained #129

Open toufunao opened 1 year ago

toufunao commented 1 year ago

I used tensor_parallel to finetune qwen model with lora in tensor parallel way. However, it cannot save the model in the end. Any help can you provide? Thanks.