search

nextcloud / llm

A Nextcloud app that packages a large language model (Llama2 / GPT4All Falcon)
24 stars 2 forks source link

Add neuralbeagle as a new llm model #53

Closed MB-Finski closed 8 months ago

MB-Finski commented 9 months ago

Adds support for the NeuralBeagle14 7B 8K context length model.

marcelklehr commented 8 months ago

What's with the failing CI?

MB-Finski commented 8 months ago

What's with the failing CI?

Hmm.. I think it might be related to this: https://github.com/ggerganov/llama.cpp/issues/3484

So we may need to update the falcon gguf model file.

EDIT: i.e. updating the deps caused this.

MB-Finski commented 8 months ago

Yup.. We will have to update the falcon model with this: https://gpt4all.io/models/gguf/gpt4all-falcon-newbpe-q4_0.gguf

provokateurin commented 8 months ago

This will close https://github.com/nextcloud/llm/issues/29