LOD processor doesn't need to perform its own same-origin check

bbcarchdev / anansi

A Linked Open Data Web crawler

https://bbcarchdev.github.io/anansi/

Apache License 2.0

0 stars 0 forks source link

LOD processor doesn't need to perform its own same-origin check #2

Closed nevali closed 9 years ago

nevali commented 10 years ago

As of 99f4f5b5bfc294919aa81fd4fd1ca7367a95fc82, each crawl object always has a location and content_location set, both of which will be absolute URLs.

As a consequence, the URL rebasing and same-origin checks in processors/lod.c are no longer necessary and should be removed.