Image dumps fail when an invalid character is present

WikiTeam / wikiteam

Tools for downloading and preserving wikis. We archive wikis, from Wikipedia to tiniest wikis. As of 2023, WikiTeam has preserved more than 350,000 wikis.

https://github.com/WikiTeam

GNU General Public License v3.0

705 stars 147 forks source link

Image dumps fail when an invalid character is present #472

Open TrashBandatcoot opened 11 months ago

TrashBandatcoot commented 11 months ago

I've tried to download a pretty messy wiki in the hopes to transfer it to Miraheze, but during the dumping process, the very first image failed because characters are present that cannot be used to create a file or folder in Windows, such as question marks or quotation marks.

IOError: [Errno 22] invalid mode ('wb') or filename: u'C:\Users\XXXXX\Desktop\PTW-2/images/3LameStudio what did you do to my boys?.png'

Removing the file from the wiki altogether fixed it.

nemobis commented 11 months ago

I'm sorry but Windows isn't an officially supported system on which to run wikiteam software. Things are going to be easier in GNU/Linux (e.g. Debian 11), although some are using WSL as well. If you plan to reimport the wiki elsewhere, it's advisable to use a filesystem similar to the source and destination servers (unless you plan to fix all files manually later).