add basic auth to enable crawling of password protected sites

[LoveBootCaptain]

Hi :) I recently used your cool little crawler and added some handy features for myself and some work usecases. we need to crawl basic auth protected sites from time to time which are not public yet. So I thought about adding it to your little tool as an handy option which might be useful in some cases or for some individuals.

kind regards

[c4software]

Thanks for the PR ! It's a really nice addition. I take a look at it right now

[c4software]

Thanks a lot ! Merged 🎉

[LoveBootCaptain]

Merci my friend.