search

lferry007 / LargeVis

Apache License 2.0
706 stars 167 forks source link

Any recommendations to run this distributed (Spark) ? #29

Open kartha01 opened 7 years ago

kartha01 commented 7 years ago

Hi,

I was wondering if there are lots of data on HDFS/Object Store and if I want to leverage Spark, what would be the best method.

Any examples/suggestions would be appreciated.

Thanks, Rajesh

tangjianpku commented 7 years ago

Currently, we cannot support distributed learning with Spark. It would be great if someone is interested in working on a distributed version.

Thanks, Jian

On Thu, Jun 29, 2017 at 6:35 AM, Rajesh Kartha notifications@github.com wrote:

Hi,

I was wondering if there are lots of data on HDFS/Object Store and if I want to leverage Spark, what would be the best method.

Any examples/suggestions would be appreciated.

Thanks, Rajesh

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/lferry007/LargeVis/issues/29, or mute the thread https://github.com/notifications/unsubscribe-auth/AE2uei-Ot068YjCvPOk0J4iIEfHbIHAyks5sItUogaJpZM4OInlB .

bigheiniu commented 6 years ago

@kartha01 Do you want to implemented this in spark platform? I would like to find teammates to do that.