salimk / Rcrawler

An R web crawler and scraper
http://www.sciencedirect.com/science/article/pii/S2352711017300110
Other
348 stars 93 forks source link

Crawling URls from dataframe #59

Open wvonmayer opened 5 years ago

wvonmayer commented 5 years ago

This is an Awesome package! Do have a question. I am trying to use the package to access a list of URL's from my website which I have inside a dataframe. The ending result I am looking for is for each of the URL's to be accessed and get the INDEX populated which will give me if they are 200, 404, etc. Any recommendations?