Fix user agent not being sent

ekalinin / robots.js

Parser for robots.txt for node.js

MIT License

66 stars 21 forks source link

Open rune-cats opened 3 years ago

rune-cats commented 3 years ago

Node http module changed the way how it handles user-agent being sent. This change reflects that.