Closed tim-mwangi closed 2 years ago
@davexroth @sanjay-nagaraj it's possible to "cure" the spans while exporting if they are projected to exceed the Producer.MaxMessageBytes
value.
How expensive is this ?
How expensive is this ?
Only affects spans larger than 1MB and it's a loop on the tags with a simple truncation and replacement of values. For each truncated attribute we add ".truncated" tag as well.
Description
For the kafka exporter, large spans - by default those over 1MB - cause an error in exporting and end up in the retry queue where they hold up the memory, eventually causing the process to run out of allocated memory and crash. We'd like to be able to "cure" the large spans by truncating the tag values to 128KiB(which is configurable)
Testing
Checklist: