Feature Request: Specify seed in python SDK

microsoft / onnxruntime-genai

Generative AI extensions for onnxruntime

MIT License

211 stars 58 forks source link

Open Ben-Epstein opened 2 weeks ago

Ben-Epstein commented 2 weeks ago

I've been using phi3-128k-onnx and it's been fantastic, thank you for your work!

I see that you specify a seed in the c bindings, would you be able to expose that to the python bindings?

natke commented 1 week ago

Glad to hear that you are enjoying it!

The missing seed from the Python API looks an omission on our part. We will get that added in.