Health check for the default granite/merlinite endpoints.

instructlab / ui

Place to hack on UI for InstructLab

Apache License 2.0

15 stars 39 forks source link

Health check for the default granite/merlinite endpoints. #327

Open vishnoianil opened 2 weeks ago

vishnoianil commented 2 weeks ago

UI supports two default model endpoints for chat (granite and merlinite). UI should have some health check mechanism to ensure that the endpoints are responding. It should also have a mechanism for notification if the endpoints are broken/down.