Open lmolkova opened 1 month ago
There is an assumption that total tokens are not always a sum of input and output tokens. If it's the case we can recommend recording total number as a separate attribute/metric.
There is an assumption that total tokens are not always a sum of input and output tokens. If it's the case we can recommend recording total number as a separate attribute/metric.