[FEATURE] Does BMInf support multiple nodes deployment?

OpenBMB / BMInf

Efficient Inference for Big Models

Apache License 2.0

572 stars 67 forks source link

[FEATURE] Does BMInf support multiple nodes deployment? #67

Open sharlec opened 1 year ago

sharlec commented 1 year ago

I was reading the documents and the technical paper, seems like the experiment are done in single Node. Does BMInf support to multiple nodes inference deployment for large model like GLM-130?