issues
search
MeetKai
/
functionary
Chat language model that can use tools and interpret the results
MIT License
1.37k
stars
107
forks
source link
Add vLLM's health and metrics endpoints
#263
Closed
QwertyJack
closed
1 month ago
QwertyJack
commented
1 month ago
Fix #260
/health
: reuse vLLM's endpoint with a reassigned variable.
/metrics
: reuse vLLM's endpoint using
mount_metrics
.
Fix #260
/health: reuse vLLM's endpoint with a reassigned variable./metrics: reuse vLLM's endpoint usingmount_metrics.