Include CentralAuth to mediawiki ignore rule

ArchiveTeam / ArchiveBot

ArchiveBot, an IRC bot for archiving websites

http://www.archiveteam.org/index.php?title=ArchiveBot

MIT License

357 stars 71 forks source link

Include CentralAuth to mediawiki ignore rule #431

Closed revi closed 4 years ago

revi commented 4 years ago

On wikimedia wikis, CentralAuth is the pandora's box responsible for crazy amount of other WMF-wiki userpages. See mine 1 for example - it has 775*3 links[2] to WMF-sisterprojects as of 2019-12-26, and it only increases when the new wiki is added to WMF farm. Therefore it is sensible to remove them from the archive target.

[2]: Link to user page (domain itself), block log, and contribution link.

JustAnotherArchivist commented 4 years ago

Only today did I realise that we added that to the wrong ignore pattern. It ignores weird loops of the form Special:CentralAuth/foo/CentralAuth/ with this, but not actually CentralAuth itself. Oops...