awslabs / multi-model-server

Multi Model Server is a tool for serving neural net models for inference
Apache License 2.0
984 stars 230 forks source link

The example in /examples/mxnet_vision/ does not work #991

Closed kylehh closed 2 years ago

kylehh commented 2 years ago

I am working on model deployment through MMS(multi-model-server) and had some difficulties to pack a model with model-archiver command. I tried model server with the example squeezenet_v1.1.mar file and it worked, but when I tried to pack my own squeezenet model, the hosting always fail ( even if I unpack the example mar file with unzip and re-pack it with model-archive, it doesn’t work)

kylehh commented 2 years ago

I think I found the reason. The model-name in model-archive command has to be the same as the prefix for param and json model file.