-
```
What steps will reproduce the problem?
1.put your robots.txt to http://localhost/robots.txt with these lines:
User-agent: *
Disallow: /
2.crawl some page of localhost
3.you will get the contents…
-
I've been using scala pickling for a project and I have run into a compile time issue. When I added a certain class structure of case classes (think of it as a tree structure), the compiler appears t…
-
This test script errors out with a simple request to amazon.com. The number of bytes parsed varies. It seems to be a bug in HTTPParser.
``` javascript
var HTTP = require('http'),
util = require…