seomoz / rep-cpp

Robot exclusion protocol in C++
MIT License
12 stars 5 forks source link

Handle leading wildcard in directive path #41

Closed tammybailey closed 5 years ago

tammybailey commented 5 years ago

This code considers one or more leading wildcard characters (*) as a special case in the Agent code. We push an additional directive to the directives_ vector in the Agent::Allow and Agent::Disallow functions which is the result of evaluating the input query stripped of leading ''s. That is, we evaluate e.g. `Disallow: /testasDisallow: /testandDisallow: /*/test`.

Issue report here: https://github.com/seomoz/rep-cpp/issues/34

tammybailey commented 5 years ago

@dlecocq would you review please and thank you?

dlecocq commented 5 years ago

I know it's already merged, it LGTM!