randaller / llama-chat

Chat with Meta's LLaMA models at home made easy
GNU General Public License v3.0
834 stars 118 forks source link

The generation will stop at ":" keyword. #29

Open shenghanwu opened 1 year ago

shenghanwu commented 1 year ago

Here is a sample: User: which medicines can be used to treat hypertension? AI: There are several medicines that can be used to treat hypertension. Some of the most common ones are:

The generation stop at "are:", any solution for it?

thefaizan commented 1 year ago

Any update on it? I am still looking for it. It has something to do with the stopping criteria definitely