bda-research / node-webcrawler

Crawler is a web spider written with Nodejs. It gives you the full power of jQuery on the server to parse a big number of pages as they are downloaded, asynchronously
MIT License
41 stars 7 forks source link

fix travis test issue #6

Closed heshamsafi closed 8 years ago

heshamsafi commented 8 years ago

issue #5 accept-encoding contains the gzip word not consists only of the word gzip.