/resources/ handle bytes in item from spider

scrapinghub / scrapyrt

HTTP API for Scrapy spiders

BSD 3-Clause "New" or "Revised" License

824 stars 161 forks source link

/resources/ handle bytes in item from spider #117

Closed pawelmhm closed 3 years ago

pawelmhm commented 3 years ago

ScrapyJSONEncoder should not crash if there are bytes in item generated by spider. Also added error handling, we should not hang when there is something unexpected in API, just return to 500 and go on.