anilpacaci / graph-benchmarking

8 stars 3 forks source link

Kafka + LDBC Driver Integration #4

Closed anilpacaci closed 7 years ago

anilpacaci commented 7 years ago

LDBC Driver generates update objects. These needs to be serialised and pushed into an update queue. Then each implementation specific consumer will consume update objects and generate implementation specific update query. (We already have gremlin consumer, we need to make gremlin producer generic producer)

aliceranzhou commented 7 years ago
aliceranzhou commented 7 years ago

two modes for driver:

aliceranzhou commented 7 years ago

ConsoleAndFileDriverConfiguration

aliceranzhou commented 7 years ago

OperationExecutorService OperationExecutorServiceThread Kafka Consumer OperationExecutor ContextRetriever (w/o StreamDefinition)

aliceranzhou commented 7 years ago

Serialization done, executor services implemented.

Remaining: implement two modes for driver

aliceranzhou commented 7 years ago

single kafka queue impl done