swsnu / bdcsfall2014

0 stars 0 forks source link

No Scatter for new CommunicationGroupDriver ?? #17

Open ks881115 opened 9 years ago

ks881115 commented 9 years ago

Now I'm trying to implement my algorithm using new communication method introduced by BroadcastREEF.

However, I found out that no addScatter method in CommunicationGroupDriver which means I have to redundantly broadcast all data.

Is there anyone who knows how to add scatter for new CommunicationGroupDriver?? or would it be OK to broadcast whole dataset?

jsjason commented 9 years ago

You should be able to load data into Compute Tasks without having to broadcast all of the data, using the Data Loading API.

ks881115 commented 9 years ago

Got it. thanks for reply!

2014-10-18 16:29 GMT+09:00 jsjason notifications@github.com:

You should be able to load data into Compute Tasks without having to broadcast all of the data, using the Data Loading AP

— Reply to this email directly or view it on GitHub https://github.com/swsnu/discussionbdcsfall2014/issues/17#issuecomment-59601934 .

hanjae commented 9 years ago

I used GroupOperator and there's addScatter method exist. You can find it in MatMul example. https://github.com/Microsoft-CISL/shimoga/tree/master/src/main/java/com/microsoft/reef/examples/groupcomm/matmul

ks881115 commented 9 years ago

But our course instruction ( https://sites.google.com/site/snubdcsfall2014/programming-assignment/elastic-group-communication-api) is recommending us to use new group communication method instead of the old one (GroupOperator). Thanks for reply though

2014-10-18 16:32 GMT+09:00 hanjae notifications@github.com:

I used GroupOperator and there's addScatter method exist. You can find it in MatMul example.

https://github.com/Microsoft-CISL/shimoga/tree/master/src/main/java/com/microsoft/reef/examples/groupcomm/matmul

— Reply to this email directly or view it on GitHub https://github.com/swsnu/discussionbdcsfall2014/issues/17#issuecomment-59601990 .