peterhn / cs121-crawler

web crawler for ics.uci.edu
0 stars 0 forks source link

Running the crawler #4

Closed pyamsoft closed 9 years ago

pyamsoft commented 9 years ago

I have begun running the crawler on openlab. Please let me know if you find any other Trap URLS that I have not added.