Feature/Integration Idea: Embedded LLM and LocalAI API support to search/query bookmarks via chat?

omnivore-app / omnivore

Omnivore is a complete, open source read-it-later solution for people who like reading.

https://omnivore.app

GNU Affero General Public License v3.0

12.68k stars 640 forks source link

Feature/Integration Idea: Embedded LLM and LocalAI API support to search/query bookmarks via chat? #3060

Open Nezteb opened 11 months ago

Nezteb commented 11 months ago

It'd be cool if there was an optional integration in Omnivore that implemented one or more AI/LLM APIs:

.gguf file format
- OSS implementation: node-llama-cpp
OpenAI API
- OSS implementation: LocalAI
- Another: gpt4all
ollama
- "Using LangChain with Ollama using JavaScript"

Some "basic" functionality would be the ability to chat with your bookmarks or even specific labels as different "agents".

As for the UX, here is an example screenshot of BoltAI's UI for adding new model APIs/interfaces:

screenshot_2023-11-01_at_22 32 45@2x

aldrinjenson commented 3 months ago

+1 This feature to ask AI and get answers based on the links I've saved could be huge I imagine the process would involve doing RAG over the article content.

There's this properiatary app which is similar and very cool.

Are there some plans to do this in the near future?