search

Stevenic / alphawave

AlphaWave is a very opinionated client for interfacing with Large Language Models.
MIT License
98 stars 9 forks source link

How to create a simple plugin model for Llama 2 #14

Open Godrules500 opened 9 months ago

Godrules500 commented 9 months ago

My eventual goal is to work with OpenAI, but for now I am having to work with Llama 2. Do you have an example of how I could extend alpha wave to work with Llama?

I will need to hit an internal API that will also need it's own login authentication.

Thanks Steve! As always, love your work!

Stevenic commented 9 months ago

Thanks! You would need to create a new Model class... Look at the OpenAIModel class for inspiration. It simply implements the PromptCompletion interface.