RallerenP / modsearchbot

Searches mods
MIT License
8 stars 1 forks source link

Searching a website for links? #5

Open MacBone opened 1 year ago

MacBone commented 1 year ago

About six months ago, Morrowind Modding History went down. The site administrator, Fliggerty, closed his other sites and said MMH would be back soon, but it's still unavailable. Another user, abot, has compiled a database with links to the archived pages on the Internet Archive, but abot's site isn't . Could the modsearchbot search abot's site for appropriate mod links? Here's abot's index: https://modlist.altervista.org/mmh/index.php

RallerenP commented 1 year ago

Is this list being continually updated? Or is it completed?

It doesn't seem like there's an API to allow searching efficiently, but I can export the list and just have the bot search through the exported file. But if the site is still being updated, then that wouldn't really work.

Assuming that the list is done, the search might not be as accurate as Bing or Nexus, as they have the data to know how to rank the search results, but it should still be fine.

Also, not all of the links have actually been archived, and I don't really know which ones. So the bot would just search through the list and get the link, even if it doesn't work.

I can't really give an estimate of when this feature will be added, but I'll work on it soon™

MacBone commented 1 year ago

The list is complete for now unless MMH opens up again. I can ask abot about an API if that would be helpful.Yes, not all the pages were archived. I maintain a separate database of house mods, and I was able to find all but one of about 100 house mods either archived or uploaded to the Nexus.On Jul 1, 2023, at 12:14 PM, RallerenP @.***> wrote: Is this list being continually updated? Or is it completed? It doesn't seem like there's an API to allow searching efficiently, but I can export the list and just have the bot search through that. But if the site is still being updated, then that wouldn't really work. Assuming that the list is done, the search might not be as accurate as Bing or Nexus, as they have the data to know how to rank the search results, but it should still be fine. Also, not all of the links have actually been archived, and I don't really know which ones. So the bot would just search through the list and get the link, even if it doesn't work.

—Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you authored the thread.Message ID: @.***>