InternLM / lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
https://lmdeploy.readthedocs.io/en/latest/
Apache License 2.0
3.15k stars 281 forks source link

[Feature] Function call #1882

Closed PredyDaddy closed 5 days ago

PredyDaddy commented 5 days ago

Motivation

Hello, can I know how to use function call after I deploy my model using lmdeploy serve.

Related resources

No response

Additional context

No response

zhyncs commented 5 days ago

ref https://github.com/InternLM/lmdeploy/pull/1856