[CON-252] Show token usage per message

continuedev / continue

⏩ Continue is the leading open-source AI code assistant. You can connect any models and any context to build custom autocomplete and chat experiences inside VS Code and JetBrains

https://docs.continue.dev/

Apache License 2.0

15.81k stars 1.2k forks source link

[CON-252] Show token usage per message #1703

Open sestinj opened 2 months ago

sestinj commented 2 months ago

Validations

[X] I believe this is a way to improve. I'll try to join the Continue Discord for questions
[X] I'm not able to find an open issue that requests the same enhancement

Problem

It's currently difficult to find out how many tokens are being used in each message

Solution

At the bottom of each message (I'm thinking next to the thumbs up/down buttons, but maybe on the left), we should show

_CON-252

mkummer225 commented 3 weeks ago

Would be nice to see estimated cost as well - could cycle through {tokens | cost | total daily spend} etc ... in the same UI chip on click or something