Open ks881115 opened 10 years ago
You should be able to load data into Compute Tasks without having to broadcast all of the data, using the Data Loading API.
Got it. thanks for reply!
2014-10-18 16:29 GMT+09:00 jsjason notifications@github.com:
You should be able to load data into Compute Tasks without having to broadcast all of the data, using the Data Loading AP
— Reply to this email directly or view it on GitHub https://github.com/swsnu/discussionbdcsfall2014/issues/17#issuecomment-59601934 .
I used GroupOperator and there's addScatter method exist. You can find it in MatMul example. https://github.com/Microsoft-CISL/shimoga/tree/master/src/main/java/com/microsoft/reef/examples/groupcomm/matmul
But our course instruction ( https://sites.google.com/site/snubdcsfall2014/programming-assignment/elastic-group-communication-api) is recommending us to use new group communication method instead of the old one (GroupOperator). Thanks for reply though
2014-10-18 16:32 GMT+09:00 hanjae notifications@github.com:
I used GroupOperator and there's addScatter method exist. You can find it in MatMul example.
— Reply to this email directly or view it on GitHub https://github.com/swsnu/discussionbdcsfall2014/issues/17#issuecomment-59601990 .
Now I'm trying to implement my algorithm using new communication method introduced by BroadcastREEF.
However, I found out that no addScatter method in CommunicationGroupDriver which means I have to redundantly broadcast all data.
Is there anyone who knows how to add scatter for new CommunicationGroupDriver?? or would it be OK to broadcast whole dataset?