search

temoto / robotstxt

The robots.txt exclusion protocol implementation for Go language
MIT License
269 stars 55 forks source link

compatible for https://github.com/google/robotstxt #23

Closed exfly closed 1 year ago

temoto commented 5 years ago

Hello. What is the issue here? Have you found a case where it is not compatible with google parser?

temoto commented 1 year ago

Closing as inactive, feel free to reopen.