InfuseAI / primehub

open-source MLOps platform
https://docs.primehub.io
Apache License 2.0
390 stars 39 forks source link

[PH-23] User can't deploy a model if it takes more than 20s to load model files #728

Open huaichehuang opened 1 year ago

huaichehuang commented 1 year ago

Bug description PrimeHub uses a health check during model deployment. However, the time it takes to import and configure the model exceeds the health check duration, resulting in the model service being incorrectly flagged as unhealthy.

Solution Separate the code in the init function into a standalone function. When predicting data, check whether the model has been imported and configured.

Key Results