Norconex / crawlers

Norconex Crawlers (or spiders) are flexible web and filesystem crawlers for collecting, parsing, and manipulating data from the web or filesystem to various data repositories such as search engines.
https://opensource.norconex.com/crawlers
Apache License 2.0
176 stars 67 forks source link

Added default polymorphic mapper for CrawlerConfig. #986

Closed essiembre closed 2 weeks ago