The summary looks like this token_summary: %{input: 5, output: 20, padding: 95}. When streaming, there is a new option :stream_done, which enables a final message and includes the usual result except for text, for example {:done, %{token_summary: ...}}.
Closes #287.
The summary looks like this
token_summary: %{input: 5, output: 20, padding: 95}. When streaming, there is a new option:stream_done, which enables a final message and includes the usual result except for text, for example{:done, %{token_summary: ...}}.