search

tgxn / lemmy-explorer

Instance and Community Explorer for Lemmy
https://lemmyverse.net/
112 stars 9 forks source link

Communites affected by the remote moderator bug are not showing in search results. #48

Closed kringger closed 1 year ago

kringger commented 1 year ago

Hi, the following bug is making it so affected communities are not showing in search results.

https://github.com/LemmyNet/lemmy/issues/3075

For example, the community https://lemmy.ml/c/ps5 no longer shows in search results as the site now returns a 404.

Until the bug is fixed in the next backend update, this community can only be found at https://lemmy.ml/c/ps5@lemmy.ml

Other communities are affected by this as well.

tgxn commented 1 year ago

Looks like they also don't show up in the communities list for "Local", and because the crawler uses that in the query, they don't get returned.

https://github.com/tgxn/lemmy-explorer/blob/main/crawler/src/crawl/community.js#L52

Not much I can do really till the upstream is resolved, I could scan all communities, but it'd be a significantly larger request.

kringger commented 1 year ago

If it is feasible, I think scanning all communities until the issue is fixed would help those afflicted. Discoverability is a real issue with Lemmy right now, and I'm sure the afflicted communities would greatly appreciate it.

I totally understand if it is too much though. I just noticed the issue and thought to make you aware of it to see if there was an easy fix.

tgxn commented 1 year ago

Thanks for letting me know! I am keeping an eye on that issue, and hopefully lemmy.ml apply the patch soon!

I had a look, and the "Local" communities currently runs to about ~60 pages of 50 items, if I pushed for non-Local, that'd likely go up to well over 200 requests.

Not really feasible to do this many pages; as even the current ~60 pages sometimes has errors half way through.

I'm gonna close this for now 👍