swsnu / bdcsfall2014

0 stars 0 forks source link

No Scatter for new CommunicationGroupDriver ?? #17

Open ks881115 opened 10 years ago

ks881115 commented 10 years ago

Now I'm trying to implement my algorithm using new communication method introduced by BroadcastREEF.

However, I found out that no addScatter method in CommunicationGroupDriver which means I have to redundantly broadcast all data.

Is there anyone who knows how to add scatter for new CommunicationGroupDriver?? or would it be OK to broadcast whole dataset?

jsjason commented 10 years ago

You should be able to load data into Compute Tasks without having to broadcast all of the data, using the Data Loading API.

ks881115 commented 10 years ago

Got it. thanks for reply!

2014-10-18 16:29 GMT+09:00 jsjason notifications@github.com:

You should be able to load data into Compute Tasks without having to broadcast all of the data, using the Data Loading AP

— Reply to this email directly or view it on GitHub https://github.com/swsnu/discussionbdcsfall2014/issues/17#issuecomment-59601934 .

hanjae commented 10 years ago

I used GroupOperator and there's addScatter method exist. You can find it in MatMul example. https://github.com/Microsoft-CISL/shimoga/tree/master/src/main/java/com/microsoft/reef/examples/groupcomm/matmul

ks881115 commented 10 years ago

But our course instruction ( https://sites.google.com/site/snubdcsfall2014/programming-assignment/elastic-group-communication-api) is recommending us to use new group communication method instead of the old one (GroupOperator). Thanks for reply though

2014-10-18 16:32 GMT+09:00 hanjae notifications@github.com:

I used GroupOperator and there's addScatter method exist. You can find it in MatMul example.

https://github.com/Microsoft-CISL/shimoga/tree/master/src/main/java/com/microsoft/reef/examples/groupcomm/matmul

— Reply to this email directly or view it on GitHub https://github.com/swsnu/discussionbdcsfall2014/issues/17#issuecomment-59601990 .