GenAI: consider recording total tokens if they are not derivable from other attributes

open-telemetry / semantic-conventions

Defines standards for generating consistent, accessible telemetry across a variety of domains

Apache License 2.0

244 stars 158 forks source link

GenAI: consider recording total tokens if they are not derivable from other attributes #1280

Open lmolkova opened 1 month ago

lmolkova commented 1 month ago

There is an assumption that total tokens are not always a sum of input and output tokens. If it's the case we can recommend recording total number as a separate attribute/metric.