search

WikiTeam / wikiteam

Tools for downloading and preserving wikis. We archive wikis, from Wikipedia to tiniest wikis. As of 2024, WikiTeam has preserved more than 600,000 wikis.
https://github.com/WikiTeam
GNU General Public License v3.0
714 stars 148 forks source link

Scribblewiki.com coverage in WikiApiary #258

Open emijrp opened 8 years ago

emijrp commented 8 years ago

Scribblewiki is an offline wikifarm. It is not indexed in WikiApiary. Can we add the 120 wikis URLs we have anyway?[2]

[1] https://wikiapiary.com/wiki/Farm:Farms [2] https://github.com/WikiTeam/wikiteam/blob/master/listsofwikis/mediawiki/scribblewiki.com

nemobis commented 8 years ago

Emilio J. Rodríguez-Posada, 07/10/2015 13:48:

Can we add the 120 wikis URLs we have anyway?

Add where? If WikiApiary, why not use its issue tracker?

emijrp commented 8 years ago

Because I want this to be done by us. WikiApiary people is inactive and have many bugs to fix, so I don't want to give them more work load.

How can we add batches of wikis to WikiApiary?

nemobis commented 8 years ago

Emilio J. Rodríguez-Posada, 07/10/2015 20:39:

Because I want this to be done by us. WikiApiary people is inactive and have many bugs to fix, so I don't want to give them more work load.

You could assign the bugs to yourself on their tracker too, but whatever.

How can we add batches of wikis to WikiApiary?

Code a bot that checks all possible variants of the domain and name on the wiki, creates the basepage in main namespace for each domain, includes the main page URL and API URL, slowly activates the wiki for the wikiapiary bots to go fetch data.

emijrp commented 8 years ago

There is a bot for that https://wikiapiary.com/wiki/Category:Oct_2014_Import Where is the code?

nemobis commented 8 years ago

Emilio J. Rodríguez-Posada, 07/10/2015 22:31:

There is a bot for that https://wikiapiary.com/wiki/Category:Oct_2014_Import Where is the code?

IIRC last time time I checked it was not published yet. More information is available in the WikiApiary issue tracker. :) Probably it's supposed to end up here: https://github.com/WikiApiary/FarmerBee