Improve Chat Page Load Perf, Offline Chat Perf and Miscellaneous Fixes - Githubissues

khoj-ai / khoj

Your AI second brain. Get answers to your questions, whether they be online or in your own notes. Use online AI models (e.g gpt4) or private, local LLMs (e.g llama3). Self-host locally or use our cloud instance. Access from Obsidian, Emacs, Desktop app, Web or Whatsapp.

https://khoj.dev

GNU Affero General Public License v3.0

12.63k stars 640 forks source link

Improve Chat Page Load Perf, Offline Chat Perf and Miscellaneous Fixes #703

Closed debanjum closed 5 months ago

debanjum commented 5 months ago

Store Generated Images as WebP

78bac4ae Add migration script to convert PNG to WebP references in database
c6e84436 Update clients to support rendering webp images inline
d21f22ff Store Khoj generated images as webp instead of png for faster loading

Lazy Fetch Chat Messages to Improve Time, Data to First Render

This is especially helpful for long conversations with lots of images

128829c4 Render latest msgs on chat session load. Fetch, render rest as they near viewport
9e558577 Support getting latest N chat messages via chat history API

Intelligently set Context Window of Offline Chat to Improve Performance

4977b551 Use offline chat prompt config to set context window of loaded chat model

Fixes

148923c1 Fix to raise error on hitting rate limit during Github indexing
b8bc6bee Always remove loading animation on Desktop app if can't login to server
38250705 Fix get_user_photo to only return photo, not user name from DB

Miscellaneous Improvements

689202e0 Update recommended CMAKE flag to enable using CUDA on linux in Docs
b820daf3 Makes logs less noisy