TensorParallel object has no attribute save_pretrained

BlackSamorez / tensor_parallel

Automatically split your PyTorch models on multiple GPUs for training & inference

MIT License

619 stars 38 forks source link

TensorParallel object has no attribute save_pretrained #129

Open toufunao opened 11 months ago

toufunao commented 11 months ago

I used tensor_parallel to finetune qwen model with lora in tensor parallel way. However, it cannot save the model in the end. Any help can you provide? Thanks.