search

huggingface / text-generation-inference

Large Language Model Text Generation Inference
http://hf.co/docs/text-generation-inference
Apache License 2.0
8.36k stars 948 forks source link

Function Calling Support #1600

Closed doc closed 4 months ago

doc commented 4 months ago

Feature request

I've only just discovered TGI but do not see in the docs how function calling is supported and in my testing seems to confirm same. I think the addition of function calling support to tgi would add value to several end users.

https://platform.openai.com/docs/guides/function-calling

Motivation

There are several compelling use cases for function calling however, my primary notification atm is data extraction. Using Langchain extraction (https://python.langchain.com/docs/use_cases/extraction) with gpt3.5 seems to work particularly well.

Your contribution

Happy to contribute with testing/validation or development as needed.

doc commented 4 months ago

Looks like there's already a PR to add support: #1587