Enhancement - Hide bad crawls from end-users

sul-dlss-deprecated / swap

(meant as a replacement for sul-dlss/openwayback but not yet there) Java application to query and access archived web material -- the code for the Stanford Web Archiving Portal (SWAP). Overlay of iipc/openwayback.

Other

1 stars 0 forks source link

Enhancement - Hide bad crawls from end-users #40

Open peterchanws opened 3 years ago

peterchanws commented 3 years ago

Bad crawls (login page only, etc.) are sometimes discovered by endusers. It would make enduser experience better if we can hide these crawls.