search

awslabs / multi-model-server

Multi Model Server is a tool for serving neural net models for inference
Apache License 2.0
995 stars 231 forks source link

using docker: multi-model-server: command not found #894

Closed johsbk closed 4 years ago

johsbk commented 4 years ago

When I try to run the example described in the documentation i get the following:

docker run -itd --name mms -p 80:8080 -p 8081:8081 awsdeeplearningteam/multi-model-server multi-model-server --start --models squeezenet=https://s3.amazonaws.com/model-server/model_archive_1.0/squeezenet_v1.1.mar
Unable to find image 'awsdeeplearningteam/multi-model-server:latest' locally
latest: Pulling from awsdeeplearningteam/multi-model-server
7ddbc47eeb70: Already exists
c1bbdc448b72: Already exists
8c3b70e39044: Already exists
45d437916d57: Already exists
8b54a0953a02: Pull complete
d53814c23f28: Pull complete
ea0cd791e65e: Pull complete
a2b066898672: Pull complete
de59f837baad: Pull complete
e91fb3083946: Pull complete
3edf18235ed4: Pull complete
84bbf072b32f: Pull complete
Digest: sha256:1bdf4c39b1e71ee6bceb251b7e46cb719266f92640006cea65f24cf2a2b9bd85
Status: Downloaded newer image for awsdeeplearningteam/multi-model-server:latest
152a3306dc78478cc5bddf1ca75f0a8994ed7f923bd413ddd44c80c759b87ec2
❯ docker logs mms
/usr/local/bin/dockerd-entrypoint.sh: line 8: multi-model-server: command not found

However if I build https://github.com/awslabs/multi-model-server/blob/master/docker/Dockerfile.cpu locally it works fine.

raxshah commented 4 years ago

I have the same issue

vdantu commented 4 years ago

Thanks for reporting this. The root cause of this was a stale container image. It must be fixed now

$ docker run -itd --name mms -p 80:8080 -p 8081:8081 awsdeeplearningteam/multi-model-server multi-model-server --start --models squeezenet=https://s3.amazonaws.com/model-server/model_archive_1.0/squeezenet_v1.1.mar
Unable to find image 'awsdeeplearningteam/multi-model-server:latest' locally
latest: Pulling from awsdeeplearningteam/multi-model-server
5c939e3a4d10: Pull complete
c63719cdbe7a: Pull complete
19a861ea6baf: Pull complete
651c9d2d6c4f: Pull complete
bb06cfbea42e: Pull complete
03d1540bb94a: Pull complete
17d6f3fcc82e: Pull complete
83cb75d883c5: Pull complete
aa38cc4d47bd: Pull complete
fe0de0c5ec19: Pull complete
78c6316aa925: Pull complete
9316b2f9d709: Pull complete
Digest: sha256:b441cc6ec7ea882fbef85162b07c9f2ced6b935eaf70e8d085e0f47218a0263e
Status: Downloaded newer image for awsdeeplearningteam/multi-model-server:latest
e11ae8d0957bd81a4a47ca3cecfc1bf8c8cdf72c47f7787a28b88e2a7fb9ecd9

$ curl -X POST localhost/predictions/squeezenet -T kitten.jpg
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0[
  {
    "probability": 0.8582232594490051,
    "class": "n02124075 Egyptian cat"
  },
  {
    "probability": 0.09159987419843674,
    "class": "n02123045 tabby, tabby cat"
  },
  {
    "probability": 0.0374876894056797,
    "class": "n02123159 tiger cat"
  },
  {
    "probability": 0.006165083032101393,
    "class": "n02128385 leopard, Panthera pardus"
  },
  {
    "probability": 0.0031716004014015198,
    "class": "n02127052 lynx, catamount"
  }
100  108k  100   454  100  108k   1189   284k --:--:-- --:--:-- --:--:--  284k

I will resolve this for now. Please feel free to raise it if you see this issue again.

vdantu commented 4 years ago

@raxshah : did this fix your issue.

raxshah commented 4 years ago

@vdantu Thanks for a quick update. Yes, it resolved