GiovanH / unofficial-homestuck-collection

An offline collection of Homestuck and its related works.
GNU General Public License v3.0
36 stars 4 forks source link

Include the fan wiki #478

Open xSke opened 1 year ago

xSke commented 1 year ago

When reading through the comic, it's often very difficult to keep track of the plot progression and relevant characters. This would normally be solved by reading through the fan wiki, but this doesn't account for a new reader's position in the story and would contain massive immediate spoilers.

Since the fan wiki (mspaintadventures.fandom.com) seems to have an edit history going back to 2009, it should be technically possible (even if it might be a pain, grumble fandom lock-in grumble) to dump the page histories and present a version of the wiki as it would have looked like at any given point in reading, and provide what should hopefully be the overall community understanding of the plot and lore at that time.

Of course, this is unofficial and fanmade content, and I'm not sure where exactly you draw the line for inclusion here, so that may be a concern. But I thought I'd suggest it anyway, since I don't see any other issues about this from a quick search.

virtadpt commented 1 year ago

It may be mirrorable; I just tasked Leandra with trying to back it up. We'll see what happens.

That said, the software underlying mspaintadventures dot fandom dot com is MediaWiki 1.37.6, and api.php is available (though when they find out they'll probably get rid of it) so it may be possible to do an export of the wiki's content (to, say, create a .zim file) for inclusion.

xSke commented 1 year ago

For reference: https://mspaintadventures.fandom.com/wiki/Special:Export may be the obvious place to go. This also supports exporting revision history. The output XML file should probably be processed somehow though.

virtadpt commented 1 year ago

This looks like the place to start: https://www.mediawiki.org/wiki/Exporting_all_the_files_of_a_wiki

virtadpt commented 1 year ago

Okay, I got it. The full wiki export (with full edit history) is here: https://drwho.virtadpt.net/files/mspawiki-20230303.zip

xSke commented 1 year ago

Is this something you would like to have in the app, for the record? I do have experience with web development, wiki wrangling, and web-based time travel (oddly specific skillset), I could possibly throw together a PR at some point probably-not-any-time-soon if you'd like.