scrapinghub / portia

Visual scraping for Scrapy
BSD 3-Clause "New" or "Revised" License
9.3k stars 1.4k forks source link

Portia server hangs and stops responding #689

Open eng1neer opened 7 years ago

eng1neer commented 7 years ago

I have a project that seems to hang Portia (though it reproduced on other projects too) . After navigating to

http://localhost:9001/#/projects/charlotte/spiders/www.charlottetilbury.com/samples/bcba-41ea-87b7/data/annotations/3cf2-4a9c-9243|2134-4338-82ed?url=http%3A%2F%2Fwww.charlottetilbury.com%2Fuk%2Fhot-lips-lipstick-miranda-may.html

Portia stops responding at all until I restart the docker container. Other projects may open successfully, but visiting the above link hangs it again. I'm running it on docker, develop branch.

I'm attaching project zip. charlotte.zip

Is there any information I can provide to help troubleshoot the issue?

ruairif commented 7 years ago

If you set verbosity=3 here then it might give you more information as to have it crashes. I assume it is a problem with the url that is being loaded.

eng1neer commented 7 years ago

I assume it is a problem with the url that is being loaded.

I haven't constructed this URL by myself. What I do is navigate to the sample in that project.

Could you please point it out where exactly verbosity=3 should be set?

ruairif commented 7 years ago

Sorry I forgot to add the link https://github.com/scrapinghub/portia/blob/develop/slyd/slyd/splash/ferry.py#L361

hackrush01 commented 7 years ago

I can't seem to reproduce the issue, the logs, as asked by @ruairif would be helpful.

1049451037 commented 6 years ago

I solved it by kill it in docker.

docker ps
sudo docker kill name_from_ps