search

joandre / MCL_spark

An implementation of Markov Clustering algorithm for Spark in Scala
MIT License
34 stars 13 forks source link

maven update #12

Closed juwitaw closed 7 years ago

juwitaw commented 7 years ago

Hello, I'm trying to use MCL_spark using maven from spark-packages When I saw, the github latest update is four months ago, but at spark-packages released date is August 2016. I wonder will there any update for maven package? Thank you

joandre commented 7 years ago

Hi,

Indeed, there will be a new update when this issue will be solved: https://github.com/joandre/MCL_spark/issues/10.

Joan

juwitaw commented 7 years ago

Thank you for your respond. I'll be waiting 👍

nishanthsiva commented 7 years ago

Hi,

Do you have Issue #10 solved yet? We are using your MCL program as part of our system but the RAM requirements are way too high for a sparse graph with about 3 million edges. Do you have a timeline on when the next update will be pushed?

Thanks

joandre commented 7 years ago

Hi nishanthsiva,

Indeed. It is not solved yet. No timeline right now. I wait for a pull-request from another user. Just to let you know that it comes from Spark API that is not adapted to sparse matrix multiplication.