Open kanihal opened 6 years ago
How to crawl and save only pages for site say : https://www.cse.iitb.ac.in/~soumen/ i.e. I dont want to crawl the domain cse.iitb.ac.in but rather just the pages that appear with prefix "https://www.cse.iitb.ac.in/~soumen/" i.e. https://www.cse.iitb.ac.in/~soumen/*
If "prefix match" crawl feature is not there, could you please add it? something like
How to crawl and save only pages for site say : https://www.cse.iitb.ac.in/~soumen/ i.e. I dont want to crawl the domain cse.iitb.ac.in but rather just the pages that appear with prefix "https://www.cse.iitb.ac.in/~soumen/" i.e. https://www.cse.iitb.ac.in/~soumen/*
If "prefix match" crawl feature is not there, could you please add it? something like