usc-cloud / goffish

USC GoFFish Graph Analytics Framework
32 stars 11 forks source link

Investigate Apache Gora as I/O for GoFFish #121

Open lewismc opened 10 years ago

lewismc commented 10 years ago

Hi Folks, Based on great discussion at XDATA event in Virginia with some of the GoFFish team. I would like to pursure the initiative to integrate Apache Gora [0] as I/O for GoFFish. We did a Google Summer of Code project for Apache Giraph last year which was very successful so we have a track record of this kind of implementation. Some documentation from the above project can be seen here [1] for those that want to understand more about what this issue involves. I am going to begin working on this issue when I can get time.

[0] http://gora.apache.org [1] http://giraph.apache.org/gora.html

charithwiki commented 10 years ago

Thanks for your interest in GoFFish. Please Join your open discussion forum at [1]. There we can have detailed discussions about how we can proceed and clarify any problems you will have. Let's use this issue to track the development progress and technical details. Also, we are open for new suggessions and improvements.

[1]https://groups.google.com/forum/?hl=en#!forum/usc-cloud

Thanks, Charith

lewismc commented 10 years ago

Thanks for the pointer. The initiaitve here is to reduce GooFFish overhead with regards to having custom adapters for datastores such as HBase, Cassandra, Acumulo, HDFS, DynmaoDB, etc. We are working on some other code right noe, but I would very much like to work on this in due course.