search

uzh / signal-collect

A framework for scalable graph computing.
www.signalcollect.com
Apache License 2.0
148 stars 32 forks source link

WebCrawler hangs when it is run with the console and in interactive mode #119

Closed pstutz closed 11 years ago

troxler commented 11 years ago

Works for me. When does it hang for you?

pstutz commented 11 years ago

I set a higher crawl depth. For some reason the whole thing is run in spite of starting it in interactive mode.

cshapeshifter commented 11 years ago

Well, it runs the whole thing because that's how the algorithm is implemented. In the Webpage class it says:

/** This method gets called by the framework after the vertex has been fully initialized. */ 
override def afterInitialization(graphEditor: GraphEditor[Any, Any]) {

and in there, the whole downloading etc is done. And apparently that method is called from WorkerImplementation.addVertex so it could be that it all happens before execute() is even called on the graph?

pstutz commented 11 years ago

You're right, I forgot it was implemented this way. Apologies. :(