search

awslabs / multi-model-server

Multi Model Server is a tool for serving neural net models for inference
Apache License 2.0
998 stars 230 forks source link

[WIP] - pre-fork initialization capabilities. #824

Closed vdantu closed 5 years ago

vdantu commented 5 years ago

DO NOT MERGE

  1. Added frontend changes to spawn a backend server at registration.
  2. Added frontend changes to attach multiple scaled-up worker to the same server.
  3. Added backend changes to add the server capabilities to the python worker.
  4. Added logs and metrics io remapping.
  5. Modfied python worker to behave as a child worker to handle connection.

Before or while filing an issue please feel free to join our slack channel to get in touch with development team, ask questions, find out what's cooking and more!

Issue #, if available:

Description of changes:

Testing done:

To run CI tests on your changes refer README.md

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

vdantu commented 5 years ago

Closing this PR in favor of #852