search

khayyatzy / Mizan

A C++ Pregel Clone with dynamic load balancing, based on a paper "Mizan: A System for Dynamic Load Balancing in Large-scale Graph Processing"
https://thegraphsblog.wordpress.com/the-graph-blog/mizan/
The Unlicense
27 stars 5 forks source link

Running mizan with Hadoop 2.5 #1

Open shuangsong1990 opened 5 years ago

shuangsong1990 commented 5 years ago

Dear authors, The cluster we can access is provided by TACC, and the lowest pre-installed Hadoop version is 2.5 (and we are not allowed to install a lower version on our own). Do you think it will be possible for us to install and run mizan with Hadoop 2.5? Thank you in advance.

khayyatzy commented 5 years ago

Dear shuangsong1990,

Hadoop 2.5 has a totally different API for HDFS which might not be compatible with Mizan's HDFS v1 apis. The only way to go in my opinion is to modify the HDFS reader of Mizan to the new version and run it again.

On Sat, Apr 27, 2019 at 1:03 AM shuangsong1990 notifications@github.com wrote:

Dear authors, The cluster we can access is provided by TACC, and the lowest pre-installed Hadoop version is 2.5 (and we are not allowed to install a lower version on our own). Do you think it will be possible for us to install and run mizan with Hadoop 2.5? Thank you in advance.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/khayyatzy/Mizan/issues/1, or mute the thread https://github.com/notifications/unsubscribe-auth/ABNJJXGV25SG22CUTOGYJDDPSN32BANCNFSM4HI2TOHA .

shuangsong1990 commented 5 years ago

Dear Khayyatzy, Do you have some ideas about where we should begin on replacing the old HDFS APIs?

khayyatzy commented 5 years ago

I will get back to you on that. Let me review the project first

On Sun, Apr 28, 2019 at 11:59 PM shuangsong1990 notifications@github.com wrote:

Dear Khayyatzy, Do you have some ideas about where we should begin on replacing the old HDFS APIs?

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/khayyatzy/Mizan/issues/1#issuecomment-487414864, or mute the thread https://github.com/notifications/unsubscribe-auth/ABNJJXC522NC6WG2TZPSDEDPSYF3TANCNFSM4HI2TOHA .