search

jcsalterego / Contrails

Contrails is an ATProto Feed Generator backed by Cloudflare Workers and Bluesky Search.
Other
80 stars 91 forks source link

Deprecating `search.bsky.social` #27

Open bnewbold opened 9 months ago

bnewbold commented 9 months ago

We are planning to tear down the legacy search.bsky.social service immanently. As noted in https://github.com/jcsalterego/Contrails/issues/26, that index has not been getting updates for about a week.

This migration was hinted at a while back (https://github.com/bluesky-social/atproto/discussions/1711), and there is a migration path to switching over to specified search endpoints on the appview (api.bsky.app). The cached public version of the appview (public.api.bsky.app) would probably be a good fit for this use case. It might require tweaks to reduce the query/refresh rate to stay within rate-limits, but a lot more hydrated metadata is now returned by the endpoint.

I think @jcsalterego has been pinged about this recently, but commenting here for visibility.

jcsalterego commented 9 months ago

Thanks for writing this up @bnewbold! I appreciate the information and definitely sunset search.bsky.social as you all intended. I will update Contrails and other projects when I have time, and thank you all for providing that endpoint for a long while!

RReverser commented 9 months ago

As noted in #26, that index has not been getting updates for about a week.

Weird, I've been adding some console.logs yesterday, and I think I still saw fresh results coming from that API, so I assumed the bug has to be elsewhere.

Are you sure the index is already not being updated?