For WAIL crawls (not Heritrix, since it has its own reporting), provide a place where the user can see what's currently being crawled (log/live update). Also provide a log so the user can see the list of URLs crawled for a particular crawl (similar to Heritrix's crawl.log).
For WAIL crawls (not Heritrix, since it has its own reporting), provide a place where the user can see what's currently being crawled (log/live update). Also provide a log so the user can see the list of URLs crawled for a particular crawl (similar to Heritrix's crawl.log).