server-side script should periodically look for items that have gone dark and use git annex rmurl to mark them as unavailable from the web

ArchiveTeam / IA.BAK

We back up a lot of stuff from around the web; now it's time to back up the Internet Archive, just in case.

GNU General Public License v3.0

87 stars 22 forks source link

server-side script should periodically look for items that have gone dark and use git annex rmurl to mark them as unavailable from the web #52

Open db48x opened 7 years ago

db48x commented 7 years ago

This prevents us from needlessly attempting to redownload them, but doesn't actually remove them from the repository; the files may still be available from other iabak repositories.