substratusai / lingo

Lightweight ML model proxy and autoscaler for kubernetes
https://www.substratus.ai
Apache License 2.0
96 stars 6 forks source link

health check results in unable to parse model error #105

Open samos123 opened 5 days ago

samos123 commented 5 days ago
2024/07/05 07:03:53 sending error response: 400: unable to parse model: unmarshal json: unexpected end of JSON

The above message was seen and I suspect it's due to health check hitting /

samos123 commented 4 days ago

This seems to be due to the lingo health check that hits /