search

WikiTeam / wikiteam

Tools for downloading and preserving wikis. We archive wikis, from Wikipedia to tiniest wikis. As of 2024, WikiTeam has preserved more than 600,000 wikis.
https://github.com/WikiTeam
GNU General Public License v3.0
714 stars 148 forks source link

uploader.py ignores past dumps if log has empty lines #90

Open emijrp opened 10 years ago

emijrp commented 10 years ago

From nemow...@gmail.com on February 02, 2014 16:48:15

Sometimes uploader.py generates empty lines, either at the beginning of the log file or at the beginning of a new run's output. However, if such empty lines exist at the next run, I often get "0 dumps uploaded previously" and the script would start everything from scratch.

Original issue: http://code.google.com/p/wikiteam/issues/detail?id=90

emijrp commented 10 years ago

From nemow...@gmail.com on February 02, 2014 09:49:30

Summary: uploader.py ignores past dumps if log has empty lines (was: uploader.py ignores past dumps if logs has empty lines)

emijrp commented 10 years ago

From nemow...@gmail.com on February 26, 2014 15:31:01

This may be fixed by adopting a proper CSV parsing library, or simply by some better invocation of the splitlines function and friends, but I didn't find how in docs when I filed this issue.