search

BlackSamorez / tensor_parallel

Automatically split your PyTorch models on multiple GPUs for training & inference
MIT License
629 stars 39 forks source link

Added int8 LLMs demo link #62

Closed BlackSamorez closed 1 year ago