Closed jpmckinney closed 5 months ago
Tests pass and I also ran:
scrapy crawlall --sample 1 --loglevel=ERROR
I added this to the crawall command to skip the ones with authentication and the many broken Digiwhist spiders:
if spider_name.startswith(('openopps', 'paraguay')) or spider_name.endswith('digiwhist'):
continue
Ah, nice and clear!
Builds on #1066
995
Some differences:
strict
where possible, but there is no strict option for dicts, so we add our own validator.return
ed instead ofyield
ed, then some code somewhere iterates over it, which turns it into tuples. Anyway, we should always yield.