search

c2siorg / b0bot

B0Bot - Bug Zero Twitter Bot
MIT License
15 stars 14 forks source link

Use open LLMs instead of openai #16

Closed hardik1408 closed 3 months ago

hardik1408 commented 6 months ago

Is your feature request related to a problem? Please describe. It is expensive to use openai credentials in an open source project. Moreover, getting free credits is also not viable.

Describe the solution you'd like I propose to use open LLMs like mistral,llama,gemma etc. We can use ollama to deploy these LLMs. Would like to start working on the same.

denxxs commented 5 months ago

Hey,

I will try to solve this by using a fine-tuned, lightweight, open-source LLM. Will create a pull request once completed.

hardik1408 commented 5 months ago

hey @denxxs I have already created a pull request #18 for the same. You can though suggest changes in the same . If required, we can work on something together.