ekalinin / robots.js

Parser for robots.txt for node.js
MIT License
66 stars 21 forks source link

Update rule matching to allow wildcards #3

Closed mlodz closed 12 years ago

mlodz commented 12 years ago

Support wildcards. For example,

/files/*.json

will match something like

/files/feed.json

ekalinin commented 12 years ago

Hi @mlodz! Have you any tests for this code?

mlodz commented 12 years ago

Ok, added some unit tests for the new wildcard code.

ekalinin commented 12 years ago

Thanks a lot. Applied only https support and one of your unittest: 77b1b9d, 1db5a7d. Wildcards supported since f417cfb.