search

neokd / NeoGPT

Chat effortlessly, execute commands, and interpret code with Llama3, Phi3, and more - your local AI assistant. Enjoy seamless interaction while ensuring ultimate privacy
https://neogpt.dev
MIT License
78 stars 64 forks source link

OpenAI integration for CLI #115

Closed savyez closed 9 months ago

savyez commented 10 months ago

Current behaviour :

Some systems may not be able to load the model quickly or fail to load it at all. As they are hardware intensive, this might result in the answer of the query being delivered very late and can be inaccurate as well.

Solution :

We need to integrate OpenAI model using OpenAI API thus if system LLM model fails to load or answers are incorrect/inaccurate user should be able to retireve the answer using OpenAI.

Tasks to be done :

Expected behaviour :

Once OpenAI is integrated, user should be able use OpenAI using python main.py --model_type --openai for CLI and select OpenAI model in ui mode.

savyez commented 10 months ago

@neokd we need to add openai model in load_llm.py files right?

neokd commented 10 months ago

Yes