search

huggingface / optimum-nvidia

Apache License 2.0
893 stars 87 forks source link

Is there support for StoppingCriteria? #123

Open RomanKoshkin opened 7 months ago

RomanKoshkin commented 7 months ago

for example

outputs = pipeline(
                prompt, 
                **self.generation_kwargs,
                stopping_criteria=[StopAtSpaceToken(prompt_len, stop_tokens, flags)])

Where StopAtSpaceToken is a subclass of StoppingCriteria.