search

janhq / jan

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)
https://jan.ai/
GNU Affero General Public License v3.0
22.12k stars 1.27k forks source link

bug: XML tags in chat completions are not rendered correctly #3646

Open abronte opened 1 week ago

abronte commented 1 week ago

Jan version

0.5.3

Describe the Bug

Jan does not render XML tags as such in chat completions. For example, prompting a model to put some data in some a tag like you will see only the data and not the tag you instructed to put the data in.

Steps to Reproduce

  1. Open new thread
  2. Prompt the LLM to put some text in an XML tags. ex w/ claude: "Put the string "Hello" in the xml tag "

Screenshots / Logs

Jan's output: Screenshot 2024-09-12 at 10 24 04 AM

Claude web UI for Screenshot 2024-09-12 at 10 24 25 AM example:

What is your OS?

imtuyethan commented 2 days ago

Thanks for reporting this @abronte. This bug can be reproduced on my end (v0.5.4-640): Image Image

We'll look into the root cause & fix it in upcoming releases.

dan-homebrew commented 2 days ago

This is likely due to our renderer - shifting it to @urmauur.

I am putting this in Sprint 21, but it may be pushed back depending on Jan's backlog.