BerriAI / litellm

Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
https://docs.litellm.ai/docs/
Other
14.55k stars 1.71k forks source link

[Feature]: Support phospho app fastassert for function calling #2088

Open krrishdholakia opened 9 months ago

krrishdholakia commented 9 months ago

The Feature

https://github.com/phospho-app/fastassert

Motivation, pitch

seems like a good oss alternative for function calling

Twitter / LinkedIn details

No response

rlouf commented 9 months ago

You might as well use Outlines directly (fastassert is a razor-thin wrapper around Outlines).