Closed pichilemino closed 6 years ago
They have some weird webserver rule which breaks all the requests to index.php with the normal parameters: http://biografias.bcn.cl/index.php?title=Especial:Exportar&e=1 works, http://biografias.bcn.cl/index.php?title=Especial:Exportar is a 404.
We have just introduced the --xmlrevisions
option for such cases. I've now made some changes to accomodate this wiki's weirdness:
https://github.com/WikiTeam/wikiteam/commit/754027de42888f663a3dd67ea478d7697e0aedae
However, it still fails: https://github.com/alexz-enwp/wikitools/issues/55
If you know the website maintainer, please ask them to inspect their webserver configuration. I see they're redirecting a lot of requests to some other CMS, they probably made some mistake in the middle of those rules.
Hi Nemo,
It's a weird wiki setup. If you visit http://biografias.bcn.cl/wiki/Especial:Exportar, it also works. The website is mantained by employees of the Library of the National Congress of Chile; and they seem to have created another website (i.e. https://www.bcn.cl/historiapolitica/resenas_parlamentarias/wiki/Jos%C3%A9_Manuel_Isla_Hevia) which "forks" the wiki articles into another layout. I'm writing them an email but I don't think they'll make a change :(
Diego Grez-Cañete, 17/05/2018 09:58:
It's a weird wiki setup. If you visit http://biografias.bcn.cl/wiki/Especial:Exportar, it also works.
Yeah. It's a relatively small wiki, you can also try and export the XML by hand. Just paste the page titles (which dumpgenerator.py manages to produce) in Especial:Exportar in groups of 5000, 1000, 500... whatever doesn't break. Then compress the different XML files together and upload to Internet Archive.
Yeah, I have done that already (dumping, I mean, just haven't uploaded it to the IA). But I haven't been able to download the images
Nevermind, now it's downloading images! Thanks!
It had some trouble with file names "Abdón". Added the following at the beginning of dumpgenerator and it went smooth afterwards
# encoding=utf8
import sys
reload(sys)
sys.setdefaultencoding('utf8')
biografias.bcn.cl downloadable here https://archive.org/details/BCN.7z
Ok, I don't think we can/should do that sys.setdefaultencoding: https://stackoverflow.com/a/3828742 (but we should definitely fix any Unicode issues sooner or later...).
I think we can't do much more here, reopen if this wiki has some issue shared with other wikis.
I'm having real trouble trying to dump http://biografias.bcn.cl/api.php They're using Mediawiki 1.17.0 and not even the older versions of dumpgenerator.py will work with this! I've tried dumping other wikis and they work, this one won't If someone could help me, it would be much appreciated for sure!
C:\Python27>python "C:\Users\diego\Desktop\Diccionario\wikiteam-master\dumpgenerator.py" --api=http://biografias.bcn.cl/api.php --xml --images Please install the wikitools 1.3+ module if you want to use --xmlrevisions. Checking API... http://biografias.bcn.cl/api.php u'<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">\n\n
\n\tC:\Python27>