search

retiman / clj-robots

A robots.txt parser written in Clojure.
http://retiman.github.com/clj-robots
MIT License
16 stars 1 forks source link

Implement robot version parsing #5

Closed retiman closed 13 years ago

retiman commented 13 years ago

Example:

User-Agent: foobar Robot-version: Version 2.0