search

brainlid / langchain

Elixir implementation of an AI focused LangChain style framework.
https://hexdocs.pm/langchain/
Other
574 stars 68 forks source link

Support Llama 2 #7

Closed brainlid closed 7 months ago

brainlid commented 1 year ago

Add support for the Llama 2 LLM.

Specifically interested in supporting Nx/Bumblebee usage. A main complaint against OpenAI/ChatGPT and Google/Bard is that private data is being sent to an external entity that is probably being used for training data.

A fully locally hosted and business-use compatible solution is preferred.

brainlid commented 8 months ago

I've gotten this working using Bumblebee running on local hardware. However, functions are not supported well outside of Llama CPP. But this is totally doable minus function support.

brainlid commented 7 months ago

Llama 2 through Bumblebee is working in v0.1.9. Functions are not supported though.