search

WikiTeam / wikiteam

Tools for downloading and preserving wikis. We archive wikis, from Wikipedia to tiniest wikis. As of 2024, WikiTeam has preserved more than 600,000 wikis.
https://github.com/WikiTeam
GNU General Public License v3.0
730 stars 151 forks source link

Handle 7z ERROR: Can't allocate required memory! #352

Open nemobis opened 4 years ago

nemobis commented 4 years ago

When 7z fails for lack of memory, launcher.py continues and creates a wikidump.7z file without any XML!

According to man 7z, the memory error is status code 8. We should retry with -mx=3 or similar when such a thing happens, until the memory suffices.

nemobis commented 4 years ago

launcher.py continues and creates a wikidump.7z file without any XML!

This should no longer be the case now that we check the exit code, so this would be only an enhancement request. (And the user should really check whether they have enough memory or everything is crashing!)