search

ScottMansfield / widow

Distributed, asynchronous web crawler
GNU Lesser General Public License v2.1
26 stars 4 forks source link

mailto:, phone:, etc break parsing #11

Open ScottMansfield opened 9 years ago

ScottMansfield commented 9 years ago

Need to recognize in a generic fashion the "prefix:" links and have a plugin parser for them