How to set stop words - Githubissues

google-deepmind / gemma

Open weights LLM from Google DeepMind.

http://ai.google.dev/gemma

Apache License 2.0

2.22k stars 269 forks source link

Open XYaoooo opened 1 month ago

XYaoooo commented 1 month ago

Hi, when I prompt gemma to answer question following format: Q:#### A:#####

Q:#### A:####

Q:##### A:

I have no idea how to stop gemma when generating "Q:".