stewartmckee / cobweb

Web crawler with very flexible crawling options. Can either use standalone or can be used with resque to perform clustered crawls.
MIT License
226 stars 45 forks source link

Thin web-server works slowly #19

Closed sunloverz closed 9 years ago

sunloverz commented 10 years ago

When i add the cobweb gem, my app uses thin web-server, and working slowly, can i change web server?

stewartmckee commented 10 years ago

You can, but just adding cobweb shouldn't cause the server to slow down. If you remove cobweb again, does it speed up?

sunloverz commented 10 years ago

My app used webrick by default, but when I added cobweb, It started to use thin web-server. I thought thin is slower than webrick

stewartmckee commented 10 years ago

Ok, I think i know what it is, Thin is included in cobweb for testing, i'll need to check whether its limited to testing. Your web app probably is now running with Thin because the gem has been installed. Think you should be able to force to webbrick by starting your server with 'rails s webrick'

stewartmckee commented 9 years ago

Better late than never, but dependency of thin has now been removed.