SAAVY / magpie

http://projectmagpie.github.io
MIT License
7 stars 0 forks source link

Add blacklist for website domains #132

Open AliceYuan opened 8 years ago

AliceYuan commented 8 years ago

can crash magpie by giving a local ip address eg localhost:8000/website?src=localhost<- deadlocks with 1 worker

magpie scrapes internal websites, we need some sort of blacklist so that magpie doesn't scrape internal ip addresses under vpn (which are not available to public)