ArchiveTeam / ArchiveBot

ArchiveBot, an IRC bot for archiving websites
http://www.archiveteam.org/index.php?title=ArchiveBot
MIT License
356 stars 72 forks source link

Move the IP check domain list to the control node #522

Open JustAnotherArchivist opened 2 years ago

JustAnotherArchivist commented 2 years ago

The pipeline has a hardcoded list of domains that must resolve to different IPs in order for jobs to start. Had the Facebook issues yesterday not been resolved as quickly, this would've led to problems as all pipelines would've had to be stopped and upgraded.

Let's move the domain list to the control node instead so it can be adjusted quickly for all pipelines at once if needed.