snarfed / bridgy-fed

🌉 A bridge between decentralized social network protocols
https://fed.brid.gy
Creative Commons Zero v1.0 Universal
553 stars 29 forks source link

atproto_firehose: filter incoming records more aggressively? #1329

Open snarfed opened 5 days ago

snarfed commented 5 days ago

Looks like we're storing and running receive tasks for lots of incoming ATProto records that don't actually result in anything getting bridged. Can we filter better in the atproto_firehose subscriber? Would save us some router CPU. Maybe first step would be to check ATProto.SUPPORTED_RECORD_TYPES.

image image
snarfed commented 5 days ago

...or are more of these activities legit than I think?

Looks like lots are legit, we have significantly more activity out of Bluesky than into it, but still probably less than half of our Bluesky receive tasks get bridged and sent. Maybe we can do more? Or maybe not, if most of them are filtered out because they're eg replying to or reposting or liking a non-bridged activity. That's heavier filtering than we want to do in atproto-hub.

image