Closed lintool closed 8 years ago
keepValidPages currently just does this:
keepValidPages
rdd.discardDate(null).keepMimeTypes(Set("text/html"))
Can we make it a bit smarter? For example:
.html
text/html
marking as done
keepValidPages
currently just does this:Can we make it a bit smarter? For example:
.html
or.html
, keep the page anyway (even if the MIME type is wrong).text/html
)