Open ksingh7 opened 3 years ago
I have partially solved the going down issue by adding a try/except to the inference function so that it crashes "smoothly". Then uvicorn restarts the process properly. It's a small patche for now, but yes, a small healthcheck endpoint would be good.
Add health checks such that if app container id down, openshift try to restart that based on health checks