Closed lifeizhou-ap closed 1 month ago
I like this - and has been asked for a bit
fyi since this is a common feature in Q/A or eval tools (langtrace, openlit, traceloop etc) you can have a look to validate approach vs what they are doing. Not suggesting change, just for context:
e.g. from openlit https://github.com/openlit/openlit/blob/b4d36f80fe1b2c6ea5faaddc2882f75db0a613af/sdk/python/src/openlit/__helpers.py https://github.com/openlit/openlit/blob/b4d36f80fe1b2c6ea5faaddc2882f75db0a613af/assets/pricing.json
Why Users can view the cost and token usage in the log file
What
exchange
[PR] (https://github.com/square/exchange/pull/32)