fiatrete / OpenDAN-Personal-AI-OS

OpenDAN is an open source Personal AI OS , which consolidates various AI modules in one place for your personal use.
https://opendan.ai
MIT License
1.59k stars 129 forks source link

Enhancements for Knowledge Base and Multimedia Content Handling #61

Open waterflier opened 10 months ago

waterflier commented 10 months ago

I would like to suggest some improvements in our current KB system:

Contextual Text Prompts in Knowledge Base: The text prompts returned by the Knowledge Base should be multiline, including the lines above and below where the relevant terms are found in the document. This would provide a richer context for the associated terms.

Token Limit and Priority in Knowledge Base: Due to the token limit, the Knowledge Base should find the highest weighted associated objects based on the provided token limit. If this approach isn't effective, I have another idea: We could only return the titles of the associated objects, and allow the LLM to decide through inner functions whether it needs to read the original text of these associated objects. If we can include a table of contents in the associated objects, it might further improve the efficiency of LLM's autonomous search.

Prompt Construction for Multimedia Content: The current structure seems more suitable for generating Knowledge Base prompts for document content. I believe we should also construct prompts for different types of multimedia content.

I look forward to hearing your thoughts on these suggestio