Feature: Implement option to use LLaMA instead of GPT

devAyushDubey / Ikaris-GPT

Auto describe issues with GPT powered IkarisGPT. Just write issue titles, IkarisGPT does the rest.

GNU General Public License v3.0

6 stars 4 forks source link

Feature: Implement option to use LLaMA instead of GPT #4

Open devAyushDubey opened 9 months ago

devAyushDubey commented 9 months ago

Description

IkarisGPT currently uses OpenAI APIs to get Issue descriptions. With the increasing API prices and restrictions coming in, it makes case for us to provide an option to use other LLM APIs (LLaMA for this particular issue).

Tasks

Re-structure the project to support such a feature.
Implement a design for the user to enter API Keys using Github Secrets.
Research and write a strong prompt for generating Issue description based on your provided context.
Write good quality code for making fast API call.
Use GitHub Action Bot for commenting out the outcome on the issue.

Expected Outcome

User should be able to specify which LLM service they want to use (GPT or LLaMA).

Bayyana-kiran commented 9 months ago

hey @devAyushDubey can u assign me this issue i can work on this?

praptisharma28 commented 9 months ago

@devAyushDubey , I can build and run a Medical Chatbot using Llama 2 on CPU Machine coz I learned doing it earlier. I can make a differebt folder for it too. If you are okay with my idea, you can assign me.

Bayyana-kiran commented 9 months ago

HEY @devAyushDubey so my idea is to build a option or feature which is able to access both the gpt api and also llama....i can have worked on api's and the feature should be user friendly. And @praptisharma28 it is FCFS(First come first serve) principle i think so.

devAyushDubey commented 9 months ago

Hey @praptisharma28 and @Bayyana-kiran, I appreciate your interest in taking up this issue. This issue as also labelled is a little complex and requires a lot of thinking before writing any code. I would appreciate if you could provide me with a rough idea of how you are going to do it.