BruceDone / awesome-crawler

A collection of awesome web crawler,spider in different languages
MIT License
6.36k stars 688 forks source link

Add nightmarejs in JavaScript section #4

Open xcarpentier opened 7 years ago

BruceDone commented 7 years ago

This framework is a high-level browser automation , not a scrape or crawler framework.

xcarpentier commented 7 years ago

I know but :).

But I think it's also important to mention, maybe another section ? high-level browser automation

Because the main goal of scraping/crawling is to transform HTML to DATA, no. Such a thing you can do with browser automation tools like nightmarejs or PhamtomJS or Selenium...

BruceDone commented 7 years ago

that's right , other section like books ,demo or other things can really help to transform HTML to data will be good enough to be put in this .