scrapinghub / scrapyrt

HTTP API for Scrapy spiders
BSD 3-Clause "New" or "Revised" License
824 stars 161 forks source link

Can scrapyrt be made to work with scrapy's start_requests array? #128

Closed doverradio closed 2 years ago

doverradio commented 3 years ago

Is this possible? I have not seen this is documentation and found some mentions of it within the codebase but I have been unable to do it.

pawelmhm commented 2 years ago

Yes, have you tried start_requests=True parameter, by default start_requests are not enabled, but if you specify some parameter it will be, see information here: https://scrapyrt.readthedocs.io/en/latest/api.html#scrapyrt-http-api