Explore different channels for cross shard communication

iggy-rs / iggy

Iggy is the persistent message streaming platform written in Rust, supporting QUIC, TCP and HTTP transport protocols, capable of processing millions of messages per second.

https://iggy.rs

MIT License

1.75k stars 81 forks source link

Explore different channels for cross shard communication #1014

Open numinnex opened 1 week ago

numinnex commented 1 week ago

Currently we use a ShardedQueue create to create our of channel for communication between shards. According to this repo, it's faster than flume. Explore different options such as crossbeam, async_channel etc..