search

BlackSamorez / tensor_parallel

Automatically split your PyTorch models on multiple GPUs for training & inference
MIT License
619 stars 38 forks source link

Fixed dispatch of tp.Sharded models #90

Closed BlackSamorez closed 1 year ago