search

s0md3v / uro

declutters url lists for crawling/pentesting
Apache License 2.0
1.21k stars 145 forks source link

Improvement Request #3

Closed HolyBugx closed 3 years ago

HolyBugx commented 3 years ago

Hi Somdev,

  1. I'd like to suggest you add the following extensions to be blacklisted. I have gathered all of these extensions manually and I think It would be nice to omit them:
'svg','img','gif','mp4','flv','ogv','webm','webp','mov','mp3','m4a','m4p','ppt','pptx','pdf','scss','tif','tiff','ttf','otf','woff','woff2','eot','htc','swf','rtf','image'
  1. Also, I would like to ask for white-listing and allowing the js extension as there are lots of interesting features/endpoints to be found on them and I don't think if they are considered "useless".

Thanks!

Kind Regards, HolyBugx

s0md3v commented 3 years ago

There's no limit to extensions we can blacklist but our aim is to block the most common ones while also keeping valuable types like pdf out of it.

For the same reason, I will only add gif and svgfrom your list. Thanks a ton!