qri-io / walk

Webcrawler/sitemapper
GNU General Public License v3.0
6 stars 2 forks source link

Add a test that confirms walk stays within its configured domains/hosts/origins #11

Open b5 opened 5 years ago

b5 commented 5 years ago

from @Mr0grog in #4:

one thing we’ll need to be able to test is that walk stays within its configured domains/hosts/origins, which means at least one test has to be able to spin up two web servers (that link to each other). We probably only need one test that does that, so it’s ok if the code for that one is a little fugly, but it does need to be possible.