Nice.. but stop sequences are needed.

Vali-98 / ChatterUI

Simple frontend for LLMs built in react-native.

GNU Affero General Public License v3.0

384 stars 20 forks source link

Closed Zibri closed 2 months ago

Zibri commented 2 months ago

On the android app.. grmma-2 2b Screenshot_2024-08-03-02-18-00-522-edit_com Vali98 ChatterUI

0wwafa commented 2 months ago

I solved by adding in the instruct page. but it would be better to have multiple stop words, not just one.

Vali-98 commented 2 months ago

You can currently add multiple stop sequences by seperating them with ,, eg <eos>,<end_of_turn>.

Its not the best solution as it hinges on , never being used in the stop sequence, but it'll work.

0wwafa commented 2 months ago

Yes.. I found out yesterday, I triend with comma and it worked.