openzim / zim-requests

Want a new ZIM file? Propose ZIM content improvements or fixes? Here you are!
https://farm.openzim.org
42 stars 3 forks source link

fandom.com [Topics/Hubs not Whole site] #503

Closed Rexadev closed 2 years ago

Rexadev commented 2 years ago

Is it possible to do it by Topic.

Example - https://ibanez.fandom.com/wiki/Ibanez_Wiki a Guitar Brand wiki. It doesn't show Music as topic but https://www.fandom.com/?s=ibanez does

Also there is things to find first like -

  1. Does fandom does topics properly.
  2. Does music contain all music topics and not other topics

They also got Hubs . Example - music.fandom.com/wiki/Music_Hub

https://community.fandom.com/wiki/Hub:Big_wikis

They also got a github https://github.com/Wikia

Popolechien commented 2 years ago

I think it's a good idea and I've had this one in my crosshairs for a while, but I would advise we get individual requests for fandom microsites (e.g. gta.fandom, witcher.fandom, etc.).

I don't think anyone (except r/datahoarders folks) would ever look forward to downloading a terabyte-size zim file.

Popolechien commented 2 years ago

@Rexadev Topics would probably be ideal. We handle them on Wikipedia but there's a consistent use of Wikiprojects there. Not sure fandom does that, we'd need to look into it. Hubs might be it.

Can you please open a ticket with this exact title (e.g. "_Music-themed fandom hub" or along those lines) to we can keep track of the issue? and please also link to their repo, should we need to build a dedicated scraper.