search

BlackSamorez / tensor_parallel

Automatically split your PyTorch models on multiple GPUs for training & inference
MIT License
629 stars 39 forks source link

GPT NeoX config #55

Closed BlackSamorez closed 1 year ago

BlackSamorez commented 1 year ago

A config for optimal GPT NeoX serving.