search

husky-team / husky

A more expressive and most importantly, more efficient system for distributed data analytics.
http://www.husky-project.com/
Other
98 stars 55 forks source link

Some problem about the examples(PageRank) #298

Closed RunyuanChen closed 6 years ago

RunyuanChen commented 6 years ago

When running the PageRank, I find there is no output file. Meanwhile, I think the format of input file should be needed.

ddmbr commented 6 years ago

The input format is as follows,

<id1> <num_nbs> <nb1> <nb2> <nb3> ...
<id2> <num_nbs> <nb1> <nb2> <nb3> ...

Everything is in integers.

As for output, could you use the HDFS::Write() instead? For the last argument (worker_id) you can obtain it using Context::get_process_id(). Let me know if you prefer an example instead.

RunyuanChen commented 6 years ago

what if I want to input a weighted graph? Is there any example algorithm for weighted graph?

Yuzhen11 commented 6 years ago

I think you can easily modify the parse function in the pagerank example. https://github.com/husky-team/husky/blob/master/examples/pagerank.cpp#L52

RunyuanChen commented 6 years ago

Thanks for your help!

ph0123 commented 5 years ago

Thanks