Open Swader opened 9 years ago
Currently, to prepare an API for Crawlbot consumption and to satisfy the required name param condition in the constructor, one has to pass in the string 'crawl'. This feels clumsy. Make URL optional and implicitly considered crawlbot-friendly?
Currently, to prepare an API for Crawlbot consumption and to satisfy the required name param condition in the constructor, one has to pass in the string 'crawl'. This feels clumsy. Make URL optional and implicitly considered crawlbot-friendly?