search

nextcloud / context_chat_backend

GNU Affero General Public License v3.0
4 stars 5 forks source link

feat: hardward detection + repair steps + other enhancements #38

Closed kyteinsky closed 3 months ago

kyteinsky commented 3 months ago
  1. hw detection for config selection
  2. repair mechanism
  3. pip deps update (and cleanup)
  4. llm call without context now offers a chat completion
  5. query + template + context(if any) is now trimmed to fit inside the context window of the llm (and window increased to 16384 tokens)
  6. pandoc issues fix
kyteinsky commented 3 months ago

fixes #30 and #27

kyteinsky commented 3 months ago

not sure why it hangs there for master. Might be due to heavy resource usage. Merging for now.