Closed danreeves closed 7 years ago
respectRobotsTxt
--ignoreRobotsTxt
Added --ignore-robots
--ignore-robots
respectRobotsTxt
with--ignoreRobotsTxt