elixir-nx / bumblebee

Pre-trained Neural Network models in Axon (+ 🤗 Models integration)
Apache License 2.0
1.27k stars 90 forks source link

Make randomization seed a serving input, rather than compile option #303

Closed jonatanklosko closed 6 months ago

jonatanklosko commented 6 months ago

Closes #284.

Now we can do Nx.Serving.run(serving, %{text: "...", seed: 0}) for text generation and similar for other servings.