[Doc]: Does vllm support function call

vllm-project / vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

https://docs.vllm.ai

Apache License 2.0

29.66k stars 4.47k forks source link

Closed leoneyar closed 5 hours ago

leoneyar commented 5 hours ago

For custom LLM, use vllm for whether or not to support function call

No response

[X] Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

DarkLight1337 commented 5 hours ago

Yes, please read the docs.