Portia server dies when the response from a url is 404

scrapinghub / portia

Visual scraping for Scrapy

BSD 3-Clause "New" or "Revised" License

9.28k stars 1.41k forks source link

Portia server dies when the response from a url is 404 #815

Open yiqiyu opened 7 years ago

yiqiyu commented 7 years ago

without any useful information printed in the console. I have to restart the server. Anyone knows how to fix this?

yiqiyu commented 7 years ago

More details: I found that it's not the 404 response that kills it. It crashes when you send a new url from the portia ui to the server after it receives a 404 response.