search

LemmyNet / lemmy

🐀 A link aggregator and forum for the fediverse
https://join-lemmy.org
GNU Affero General Public License v3.0
13.24k stars 879 forks source link

How to deal with the same URL posted to multiple communities. #131

Closed dessalines closed 5 years ago

dessalines commented 5 years ago

When a single URL gets posted, multiple times, to multiple communities, it might be nice to:

mister-monster commented 5 years ago

There is an issue with this, which is that if the same post is posted on two communities on different instances, the options are to not notice, or for every federated instance to request information from every other federated instance about every post made. This would not work well at scale.

trosel commented 5 years ago

Pointing out that tags are a possibility. Prismo has a simple solution to spam which is that each post can only use 5 tags maximum.

To be fair though, I think Prismo is designed more to be one instance per community. Whereas Lemmy is designed to be many communities on one instance.

mister-monster commented 5 years ago

Yeah, Prismo is more like twitter (or mastodon) with upvoting. Instead of communities you have topics (hashtags).

Lemmy differs in that it is community oriented, not topic oriented.

I think this issue is specifically asking how to automate linking two identical posts posted in two or more separate communities. My point above is that this works on one instance hut could get messy when doing it across many instances.

mister-monster commented 5 years ago

So it looks to me like building something like this will involve getting a list of all federated instances and searching them all for identical content, building a specialized search engine essentially.

If search functionality is already on the road map it would probably be best to knock this out with that.

One way to show identical content is for a community mod or instance admin to run a bot that uses that search engine every time a new post happens on the instance or community, and comment with the links it finds.

dessalines commented 5 years ago

This could do a simple db search for that same URL link, and show a : Also posted to /c/bleh 34 days ago or whenever.