search

awslabs / multi-model-server

Multi Model Server is a tool for serving neural net models for inference
Apache License 2.0
995 stars 231 forks source link

inference with standalone or distributed mode? #914

Open PayneJoe opened 4 years ago

PayneJoe commented 4 years ago

Does it support distributed inference while training with parameter server?