Closed saucam closed 4 years ago
We want to add a spark ETL job that will push output data from fink into Janusgraph. There should be a configurable option to load the data schema as well, which will read the schema from parquet data and write to janusgraph before loading the data.
fink --schema and data--> Hbase | |__> parquet files--grafink --> JanusGraph
Addressed by #4
We want to add a spark ETL job that will push output data from fink into Janusgraph. There should be a configurable option to load the data schema as well, which will read the schema from parquet data and write to janusgraph before loading the data.
fink --schema and data--> Hbase | |__> parquet files--grafink --> JanusGraph