Remove the odd self.extend Snapcrawl - nobody knows why we needed this.
Remove uri dependency, now only using Addressable::URI.
The Addressable::URI.join is better than URI.join, since it already escapes. So, we no longer rescue invalid URIs and escape them. This should hopefully all yield a more stable behavior when encountering invalid URIs.
self.extend Snapcrawl- nobody knows why we needed this.uridependency, now only usingAddressable::URI.Addressable::URI.joinis better thanURI.join, since it already escapes. So, we no longer rescue invalid URIs and escape them. This should hopefully all yield a more stable behavior when encountering invalid URIs.