unipop-graph / unipop

Data Integration Graph
Apache License 2.0
205 stars 35 forks source link

OLAP GraphComputer #32

Open rmagen opened 8 years ago

rmagen commented 8 years ago

Theoretically we should be able to run distributed Unipop queries on Spark or something. Some of Unipop's data sources even have Hadoop integration (e.g. Elasticsearch RDD, Jdbc RDD, etc). Utilizing a Unigraph's schema configuration, this feature should provide Unipop's users a transparent, zero-configuration way to execute distributed queries over their data.

Questions

  1. Should we implement Tinkerpop's GraphComputer? What does that entail?
  2. Can we utilize Tinkerpop's HadoopGraph implementation? If so, how?
  3. Can we utilize Tinkerpop's SparkGraphComputer (is that the name)? If so, how?
rmagen commented 8 years ago

This answers the questions. Seems too easy!