khoj-ai / khoj

Your AI second brain. Get answers to your questions, whether they be online or in your own notes. Use online AI models (e.g gpt4) or private, local LLMs (e.g llama3). Self-host locally or use our cloud instance. Access from Obsidian, Emacs, Desktop app, Web or Whatsapp.

https://khoj.dev

GNU Affero General Public License v3.0

12.64k stars 640 forks source link

Fix plaintext HTML parsing and rendering #464

Closed sabaimran closed 1 year ago

sabaimran commented 1 year ago

Incoming

Use beautifulsoup to pull out just the relevant text from an HTMl page
When rendering, strip any tags that might be present
Save the conversations in the conversation history even if no relevant notes were found