Closed uday-rana closed 1 week ago
Add a new command-line flag: --token-usage or -t. When the program is run with the --token-usage/-t flag set, extra information will be reported to stderr about the number of tokens that were sent in the prompt and returned in the completion.
--token-usage
-t
stderr
@mayank-Pareek
uday-rana
commented
1 week ago
Add a new command-line flag:
--token-usageor-t. When the program is run with the--token-usage/-tflag set, extra information will be reported tostderrabout the number of tokens that were sent in the prompt and returned in the completion.