nathell / skyscraper

Structural scraping for the rest of us.
405 stars 10 forks source link

Nil `:url` and non-nil `:processor` should not terminate scraping #6

Closed nathell closed 8 years ago

nathell commented 8 years ago

When a processor encounters a context with a nil :url (e.g., because a link was not encountered on the parent page where it was supposed to), this should not trigger an error. Instead, a warning should be issued (see #5), and scraping should continue as if the processor returned an empty seq of contexts.