Open NikosDi opened 3 days ago
Hello. I could be blind but I simply can't find a setting or another way to see the speed of replies, some kind of token report of the chat.
It would be useful to add tokens per second metric (tok/s)
thank you
related #1404
timothycarambat
commented
1 day ago timothycarambat
commented
1 day ago
What would you like to see?
Hello. I could be blind but I simply can't find a setting or another way to see the speed of replies, some kind of token report of the chat.
It would be useful to add tokens per second metric (tok/s)
thank you