hyperlane-xyz / hyperlane-monorepo

The home for Hyperlane core contracts, sdk packages, and other infrastructure
https://hyperlane.xyz
Other
239 stars 271 forks source link

Epic: Relayer Throughput #3570

Open nambrot opened 2 months ago

nambrot commented 2 months ago

Full context here: https://www.notion.so/hyperlanexyz/Improving-Relayer-Throughput-43462a3f52d547458e55d9c66ac93e2f

We noticed that the relayer cannot submit messages as fast as new ones arrive. This increases the latency of message delivery, affecting user experience and causing many false alarms in our monitoring.

After considering both pipelining and batching of message submission, we'll initially go with batching, as it can be shipped incrementally (initially EVM only, for chains that already support multicall).

### Tasks
- [ ] https://github.com/hyperlane-xyz/issues/issues/1057
- [ ] https://github.com/hyperlane-xyz/hyperlane-monorepo/issues/3628
- [ ] https://github.com/hyperlane-xyz/hyperlane-monorepo/issues/3630
- [ ] https://github.com/hyperlane-xyz/hyperlane-monorepo/issues/3703
- [ ] https://github.com/hyperlane-xyz/hyperlane-monorepo/issues/3704
- [ ] https://github.com/hyperlane-xyz/hyperlane-monorepo/issues/3705
- [ ] https://github.com/hyperlane-xyz/hyperlane-monorepo/issues/3706
- [ ] https://github.com/hyperlane-xyz/hyperlane-monorepo/issues/3707
- [ ] https://github.com/hyperlane-xyz/hyperlane-monorepo/issues/3708
- [ ] https://github.com/hyperlane-xyz/hyperlane-monorepo/issues/3709
- [ ] https://github.com/hyperlane-xyz/hyperlane-monorepo/issues/3722
- [ ] https://github.com/hyperlane-xyz/hyperlane-monorepo/pull/3811
yorhodes commented 2 months ago

this sets us up nicely for some transient storage/ISM caching stuff too 😄

tkporter commented 2 months ago

Created https://github.com/hyperlane-xyz/hyperlane-monorepo/issues/3664 where I moved some of the longer range issues to