Add part about un-crawl-able publishers

[MaxDall]

This adds a small part about publishers using bot protection and how to verify the publisher one wishes to add doesn't