search

WikiTeam / wikiteam

Tools for downloading and preserving wikis. We archive wikis, from Wikipedia to tiniest wikis. As of 2023, WikiTeam has preserved more than 350,000 wikis.
https://github.com/WikiTeam
GNU General Public License v3.0
706 stars 147 forks source link

dumpgenerator.py: Dump previous file revisions as well. #285

Open wertercatt opened 7 years ago

wertercatt commented 7 years ago

In order to accurately dump a wiki's images, the previous revisions should be dumped as well. See File:Construction sheet of Flag of the People's Republic of China.svg on Wikimedia Commons for an example of how past revisions are laid out. Past revisions are named in the form yyyyMMddHHmmSS![filename].[ext]

Wikiteam-on-Windows commented 5 years ago

@wertercatt WOW YES this is important, how many "complete wiki dumps" might be missing important stuff because of this due to sometimes the old versions of pictures being TOTALLY different, this is very serious especially on more argued over things like that, GOOD SPOT

It's actually a bit worrying this issue looks like it's just been languishing here for 3 years when meanwhile a lot of wiki dumps being uploaded are actually "wrong" because they include full XML history but NOT full image history

It seems like Wikiteam isn't being developed as actively as it used to be (the main page has a lot of old updates) - you have been here longer, what do you think should happen, maybe should try canvass for more volunteers or something?

nemobis commented 4 years ago

you have been here longer, what do you think should happen

Easy, everyone should be downloading more wikis instead of waiting for others to do it. ;-)