search

awslabs / multi-model-server

Multi Model Server is a tool for serving neural net models for inference
Apache License 2.0
998 stars 230 forks source link

Multiple fixes #836

Closed vdantu closed 5 years ago

vdantu commented 5 years ago

Before or while filing an issue please feel free to join our slack channel to get in touch with development team, ask questions, find out what's cooking and more!

Issue #, if available:

  1. This change makes the model registration a synchronous call by default.
  2. This change makes model loading experience consistent. Currently when customers start MMS without any models, MMS looks up "default_workers_per_model" configuration to determine the number of workers. But, during registration this doesn't happen. This change keeps these two behaviors consistent.

Description of changes:

Testing done:

To run CI tests on your changes refer README.md

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.