search

webignition / robots-txt-file

Models a robots.txt file
MIT License
18 stars 3 forks source link

Recognise "field:" as a valid directive #10

Closed webignition closed 7 years ago