issues
search
USStateDept
/
search
1
stars
0
forks
source link
Create a generic crawler to fire off scraping jobs
#548
Closed
captjt
closed
7 years ago
captjt
commented
7 years ago
[x] Generate a crawler to start at www.state.gov and return some results with links and nested levels
captjt
commented
7 years ago
[x] Start storing the results into a logging document
[x] When successful crawl -> display html content from crawled page