Closed yuanzhi-zhu closed 3 days ago
Thank your for opening source such a great work
I got the above error when running the inference code.
I installed the env followed the instructions in Readme, and it seems that we need PyTorch > 2.1 to have PrepareModuleOutput in torch.distributed.tensor.parallel.
Did I missed something here?
Have you got any solution? I got the same error
@WeizhenEricFang Just install PyTorch > 2.1 and resolve some other conflicts
Thank your for opening source such a great work
I got the above error when running the inference code.
I installed the env followed the instructions in Readme, and it seems that we need PyTorch > 2.1 to have PrepareModuleOutput in torch.distributed.tensor.parallel.
Did I missed something here?