search

MarginaliaSearch / submit-site-to-marginalia-search

Submit websites to be crawled by Marginalia Search here
Other
21 stars 152 forks source link

Request for indexing: Miraheze wikis #191

Open FurblandChannel opened 2 months ago

FurblandChannel commented 2 months ago

Miraheze is an independent nonprofit wiki host with lots of good wikis and content. Their homepage is https://miraheze.org/ and a sitemap of all wikis they host can be found at https://static.miraheze.org/sitemap.xml

the only domain not included on their global sitemap is https://issue-tracker.miraheze.org/

vlofgren commented 1 month ago

I'll need to look into how to add these in a way that makes sense. Seems a fair number of their domains are dead :-/

FurblandChannel commented 1 month ago

I'll need to look into how to add these in a way that makes sense. Seems a fair number of their domains are dead :-/

They have an auto-deletion policy, where if a site is inactive for a year, the site is "archived" (which returns some variety of 4XX, if I'm not mistaken).