artero / jambots

Create custom OpenAI ChatBots
MIT License
7 stars 1 forks source link

Add support to Llama.cpp #14

Open artero opened 1 year ago

artero commented 1 year ago

Allow the possibility to use llama.cpp models.

Planned changes:

artero commented 1 year ago

Currently exploring the implementation of llama.cpp by utilizing the llama_cpp.rb Ruby binding. This experimentation is taking place in the experimental-llama-client branch.