Add link to headless-chrome-crawler to JavaScript section

BruceDone / awesome-crawler

A collection of awesome web crawler,spider in different languages

MIT License

6.5k stars 709 forks source link

Add link to headless-chrome-crawler to JavaScript section #29

Closed yujiosaka closed 6 years ago

yujiosaka commented 6 years ago

headless-chrome-crawler provides simple APIs to manupluate Headless Chrome/Chromium and allows you to crawl these single page applications with the following features:

Configure concurrency, delay and retry
Pluggable cache such as Redis to skip duplicate requests
Pause and resume at any time
Insert jQuery automatically
Emulate device
Priority queue
Promise support