search

MeetKai / functionary

Chat language model that can use tools and interpret the results
MIT License
1.37k stars 107 forks source link

Update server_vllm.py #253

Closed bet0x closed 1 month ago

bet0x commented 1 month ago

Hello,

There's an error occurring in the /v1/models endpoint of the API server. The error is happening because the served_model variable is a list instead of a string, which is causing validation errors when trying to create a ModelCard object.

jeffreymeetkai commented 1 month ago

Hi, thanks for the fix! I made some other changes too, mainly refactoring the served_model = [args.model] instead of using either args.served_model_name or args.model. We'll wait for #257 to be ready then I will merge this. 🚀