prompt_eval_count is only defined on the first request

ollama / ollama-js

Ollama JavaScript library

https://ollama.ai

MIT License

1.56k stars 103 forks source link

Open madflow opened 3 months ago

madflow commented 3 months ago

prompt_eval_count is only defined on the first "chat" or "generate" request.
It is undefined on the second request with the same content.
When implementors rely on this field to be a not nullable number, this might be surprising.
https://github.com/ollama/ollama/issues/2068