search

awslabs / multi-model-server

Multi Model Server is a tool for serving neural net models for inference
Apache License 2.0
984 stars 230 forks source link

Validate MMS process during start #1005

Open nskool opened 1 year ago

nskool commented 1 year ago

Basing this issue on a similar issue for TorchServe, reported from a customer: https://github.com/pytorch/serve/issues/1862

Request: MMS needs to verify the pid is a real MMS process.

Motivation: This feature is able to avoid MMS restart failure if system reuses a pid for the other application.