Add Support for Bamboo LLM - Githubissues

ggerganov / llama.cpp

LLM inference in C/C++

MIT License

60.95k stars 8.7k forks source link

Add Support for Bamboo LLM #8099

Open ffroquemartinez opened 4 days ago

ffroquemartinez commented 4 days ago

Prerequisites

[X] I am running the latest code. Mention the version if possible as well.
[X] I carefully followed the README.md.
[X] I searched using keywords relevant to my issue to make sure that I am creating a new issue that is not already open (or closed).
[X] I reviewed the Discussions, and have a new and useful enhancement to share.

Feature Description

Please allow for usage of Bamboo-DPO-v0.1-gguf/bamboo-7b-dpo-v0.1.Q4_0.powerinfer.gguf

Motivation

Would like to have Bamboo running locally to avoid security breach of internal data.

Possible Implementation

No response