search

janhq / jan

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)
https://jan.ai/
GNU Affero General Public License v3.0
23.32k stars 1.36k forks source link

feat: Indicator light for model status (API) #3405

Open eckartal opened 2 months ago

eckartal commented 2 months ago

Is your feature request related to a problem? Please describe it

There is currently no easy way to tell if the selected model is up or down without attempting to use it - which can lead to unnecessary delays and frustrations.

Describe the solution

Add a green/red light indicator that shows whether the currently selected model is up or down.

Teachability, documentation, adoption, migration strategy

No response

What is the motivation / use case for changing the behavior?

This would provide a clear visual cue about the status of their selected model before attempting to use it.

imtuyethan commented 2 months ago

I think this is quite hard to do? @louis-jan

0xSage commented 2 months ago

I still think this is a good idea. Why is it hard? We already have this feature in settings:

image

I think Emre just means a shorter version of this that shows up in model selector