Logits/Probabilities along with the generated token

ollama / ollama-python

Ollama Python library

https://ollama.com

MIT License

4.04k stars 339 forks source link

Logits/Probabilities along with the generated token #156

Open magic-YuanTian opened 4 months ago

magic-YuanTian commented 4 months ago

Hi!

When generating tokens, I'm wondering if Ollama can also provide logits/probability distribution over the vocabulary. This would be a very useful feature in many use cases.

Thanks!

paraschopra commented 3 months ago

any update?

daisyfickle commented 2 months ago

can it?