TeamHG-Memex / autologin

A project to attempt to automatically login to a website given a single seed
Apache License 2.0
123 stars 44 forks source link

Formasaurus is an option. #4

Closed lukemaxwell closed 9 years ago

lukemaxwell commented 9 years ago

Formasaurus is used by default, unless formasaurus=0 is part of the request to scrapyd. Set some scrapy settings defaults for the loginspider to ensure firewalls aren't triggered: 1 concurrent request per domain, and download_delay of 1 second. This should become a option parameter later on. Couple bug fixes.