search

Vali-98 / ChatterUI

Simple frontend for LLMs built in react-native.
GNU Affero General Public License v3.0
591 stars 31 forks source link

AI replies showing suffix #66

Closed thomasiaticus closed 3 months ago

thomasiaticus commented 3 months ago

Every output of the AI appends <|end|><|endoftext|> at the end.

Vali-98 commented 3 months ago

I will need more infomation, what model was used here? You may be using the incorrect instruct for your model.

doncamillo0815 commented 3 months ago

Is it possible that you could provide an example Instruct for e.g. Llama3 or Gemma? I'm also having trouble getting the Instruct to work properly for the local inference.

Vali-98 commented 3 months ago

There are presets for Llama3 and Gemma in the instruct menu. Closing this as this may not be app related, but configuration.