salimk / Rcrawler

An R web crawler and scraper
http://www.sciencedirect.com/science/article/pii/S2352711017300110
Other
348 stars 93 forks source link

Depricated Function #72

Open delta2echo opened 4 years ago

delta2echo commented 4 years ago

I was trying to run Rcrawler with this command:

Rcrawler(Website = CrawlURL, no_cores = 2, no_conn = 2,MaxDepth = 1, DIR = storagePath,RequestsDelay = 2, Obeyrobots = TRUE,URLlenlimit = 225, Timeout = 8, Useragent = userAgent,ExtractAsText = TRUE)

and I get this output: In process : 1.. Progress: 100.00 % : 1 parssed from 1 | Collected pages: 1 | Level: 1

danrg commented 4 years ago

It could be a bug with Rcrawler. Please include a small example that reproduces the problem. The above command includes some variables with unknown values, which makes it difficult for someone else to try it out.