search

MuiseDestiny / zotero-gpt

GPT Meet Zotero.
GNU Affero General Public License v3.0
5.24k stars 215 forks source link

Support for local LLMs #317

Open santiago-afonso opened 7 months ago

santiago-afonso commented 7 months ago

Hello. With the release of Llama 3 8B, user can now run good quality LLMs locally with a recent computer. (A Meteor Lake Core 155 laptop with a ~13 TOPs NPU can run it at ~18tokens/sec.) Please support local LLM integration, as this would avoid paying for the OpenAI API.

Thanks!!

MuiseDestiny commented 7 months ago

image

Very soon support, currently implemented.