search

ohmplatform / FreedomGPT

This codebase is for a React and Electron-based app that executes the FreedomGPT LLM locally (offline and private) on Mac and Windows using a chat-based interface
http://www.freedomgpt.com
GNU General Public License v3.0
2.61k stars 358 forks source link

No context between prompts #3

Open ChrisKretschmer opened 1 year ago

ChrisKretschmer commented 1 year ago

I made the app work on windows, but am wondering, if its intended, that there is no context between individual queries like ChatGPT has?

ItsPi3141 commented 1 year ago

This uses alpaca.cpp, which has been abandoned. Only the new llama.cpp, which now has support for alpaca, supports context memorization.

ohmguru commented 1 year ago

Hey there, it's simple to turn on context with a few lines of code, but we found the output quality deteriorates considerably on subsequent responses even on llama.cpp. Feel free to submit a PR if you can get the context feature working well.