Recommendation for open source models for function calling.

brainlid / langchain

Elixir implementation of a LangChain style framework.

https://hexdocs.pm/langchain/

Other

503 stars 58 forks source link

Recommendation for open source models for function calling. #146

Open nyo16 opened 5 days ago

nyo16 commented 5 days ago

Hi, I know that the library is more optimized towards OAI models but I was wondering if anyone have tried to use Ollama and llama 3 or nous-hermes2pro-llama3-8b for function calling. I tried with some prompt variations but not much luck.

cpursley commented 1 day ago

I've had good luck with firefunction 2: https://fireworks.ai/blog/firefunction-v2-launch-post

https://huggingface.co/fireworks-ai/llama-3-firefunction-v2