iggy-rs / iggy

Iggy is the persistent message streaming platform written in Rust, supporting QUIC, TCP and HTTP transport protocols, capable of processing millions of messages per second.
https://iggy.rs
MIT License
1.84k stars 85 forks source link

Instrument shards #1012

Open numinnex opened 3 months ago

numinnex commented 3 months ago

Currently there is no logging and instrumenting of the shards, trace the route of request that is both send and received by a shard and instrument the shard and it's workload (in the future we could store in some thread locals bunch of metrics and use those to either reorder the shards ring or perform other form of load equalization.