search

matteoredaelli / ebot

Ebot, an Opensource Web Crawler built on top of a nosql database (apache couchdb, riak), AMQP database (rabbitmq), webmachine and mochiweb. Ebot is written in Erlang and it is a very scalable, distribuited and highly configurable web cawler. See wiki pages for more details
http://www.redaelli.org/matteo-blog/projects/ebot
GNU General Public License v3.0
330 stars 55 forks source link

error parsing url http://www.mingw.org/docs.shtml #10

Open matteoredaelli opened 14 years ago

matteoredaelli commented 14 years ago 
                <<"http://www.mingw.org/docs.shtml">>}}

=ERROR REPORT==== 8-May-2010::20:12:48 === Error in process <0.119.0> with exit value: {{case_clause,<<10468 bytes>>},[{mochiweb_html,find_qgt,2},{mochiweb_html,tokenize,2},{mochiweb_html,tokens,3},{ebot_html_util,get_links,2},{ebot_html_util,get_links,2},{ebot_web,fetch_url_links,2},{ebot_web,analyze_url_body,2},{ebot_web...

matteoredaelli commented 14 years ago

I opened an issue at http://code.google.com/p/mochiweb/issues/detail?id=71