Bluesky: switch from firehose to jetstream

snarfed / bridgy-fed

🌉 A bridge between decentralized social network protocols

https://fed.brid.gy

Creative Commons Zero v1.0 Universal

724 stars 39 forks source link

Bluesky: switch from firehose to jetstream #1491

Open snarfed opened 6 days ago

snarfed commented 6 days ago

Not really a pain point for us right now, our firehose consumer is stable and only 20-30% of a core, even with the firehose peaking above 1500khz right now, but this would be a good courtesy to the Bluesky team. Jetstream consumers cost them significantly less than firehose consumers, in bandwidth and CPU, and we don't currently verify signatures or use the MST blocks, so we don't really need the firehose itself.

A big chunk of this is done in a stash already.

snarfed commented 1 day ago

Need to prioritize this now due to https://github.com/bluesky-social/atproto/discussions/3036