search

google / generative-ai-docs

Documentation for Google's Gen AI site - including the Gemini API and Gemma
https://ai.google.dev
Apache License 2.0
1.62k stars 568 forks source link

Sampler method Gemma Pytorch #405

Closed liangtelkamp closed 5 days ago

liangtelkamp commented 4 months ago

Description of the feature request:

Is it possible to do sampling for n_samples with the GemmaCausalLM in PyTorch?

What problem are you trying to solve with this feature?

No response

Any other information you'd like to share?

No response