search

microsoft / onnxruntime-genai

Generative AI extensions for onnxruntime
MIT License
259 stars 65 forks source link

Extend GeneratorParams.SetSearchOption to allow setting strings #454

Closed koepalex closed 3 weeks ago

koepalex commented 1 month ago

First of all, awesome library, it is fun to use 👏 It would be great extension to allow other types of search options for example string[].

Use case would be to pass stop words into the model (for example as defied by the HuggingFace TextGenerationApi parameter stop).

natke commented 3 weeks ago

Thank you for the suggestion @koepalex! I'm moving this into our new features area in Discussions