Open jjsaunier opened 9 years ago
I would like to support configurable list of ignore urls via config, see https://github.com/umpirsky/centipede/issues/2.
Standard auth methods are also in planning, but I would like to keep crawler interface simple, including constructor.
Now you can do it
./bin/centipede run http://github.com -c /home/user/[..]/centipede.yml
with :
ignore:
- '/blog'
- '/explore'
for example
Cool, I will revisit this PR and do it in separate PR to split config implementation and auth.
I also want config to be in the root of target project like for Behat and PHPSpec.
Any progress on this ? I just got a legacy project to manage that needs authentication and I would love to use centipede to ensure each page is accessible upon migrations/changes.
@gnutix No, sorry. I didn't have chance to work on it lately.
You can fork it and adopt to your needs, then post link here and we will see what can be reused/merged.
PR on centipede crawler is coming.