Fetch & Process - Githubissues

gauthamsunjay / ariados

A scalable web crawling framework using lambdas

0 stars 0 forks source link

Fetch & Process #6

Closed cqhfut closed 5 years ago

cqhfut commented 5 years ago

[x] Given a URL, download the site data (fetch)
[x] Call the handlers parse function on this data (process)
[x] Return data and links to master