search

jskjott / webring

Create a home online
https://webring.recurse.com
33 stars 28 forks source link

Custom search engine for webring(!) #33

Open cblgh opened 3 years ago

cblgh commented 3 years ago

Hi folx!

I recently released an open source search engine called Lieu that was partially inspired & made for the Merveilles Webring I'm part of. Lieu's focus is indexing networks of community sites (&& webrings), surfacing interesting articles, pages & projects hidden in their depths.

I made it in such a way that other webrings (like the Recurse Center's!) could easily deploy their own search engine :)

Anyway, I wanted to let you all know that it exists & offer my help in setting it up (tho probably on another machine than the one that hosts the Merveilles one).

Here's the code & project readme: https://github.com/cblgh/lieu

🖤

jskjott commented 3 years ago

Hi there!

I was joyfully exploring the Merveilles Webring via Lieu just yesterday! Lieu seems to really encapsulate the spirit of webrings, such a wonderful project.

Would love to help set it up for the Recurse Center's webring! 🌱

I wonder if the RC Heap Community Cluster would be appropriate for hosting the search engine?

cblgh commented 3 years ago

Oh, I'm happy you think so :3

I wonder if the RC Heap Community Cluster would be appropriate for hosting the search engine?

That definitely seems like a good candidate for the engine! Although in terms of resources, Lieu is reallly meagre haha. The entire directory—containing the binary & the Merveilles-populated database—takes up ~63 MB :) Crawling + indexing takes like, maybe 15 minutes in total.

I think the most important criteria is that the machine is easily accessible by RC attendees & alums. I'm still working out some minor kinks with the search engine, so there might be some silly crashes (& resulting patches) waiting as a result of my too eager debug-&-exit statements. If the RC Heap fits that criteria, then it sounds perfect :)