search

unipop-graph / unipop

Data Integration Graph
Apache License 2.0
205 stars 35 forks source link

Will unipop support in-memory gremlin providers like redis? #118

Open zxnblake opened 7 years ago

zxnblake commented 7 years ago

Hi @seanbarzilay : Is there a plan to support in-memory gremlin providers like redis? I have done some performance testing on ES cluster( 5 powerful machines), with about 10,000,000 vertices and 200,000,000 edges. There are about 20 to 30 edges between adjacent vertices. When do traversal from vertex to vertex with 3 hops (v-v-v-v), it spent around 10 seconds. The graph traversal is a exponential increase with time-complexity. Do you have any good practice on this? Maybe using the in-memory db like redis could enhance the performance?

seanbarzilay commented 7 years ago

Currently I'm not planing on adding any more providers to Unipop, but I'm hoping to finish my developers guide soon so people can implement more providers as they need.