ldbc / ldbc_snb_datagen_hadoop

The Hadoop-based variant of the SNB Datagen
https://ldbcouncil.org/benchmarks/snb
Apache License 2.0
12 stars 13 forks source link

How can I get the raw data including creationdata, deletiondate and explicitlydeleted ? #4

Closed prncoprs closed 2 years ago

prncoprs commented 2 years ago

I find that we can get the raw interactive snb data in the ldbc_snb_datagen_spark repo. In the raw interactive snb data, there are columns like creationdata, deletiondate and explicitlydeleted. So how can I get the raw data using ldb_snb_datagen_hadoop ?

szarnyasg commented 2 years ago

Hi @prncoprs, running deletions is currently not a part of the SNB Interactive workload. We plan to add support for this later (https://github.com/ldbc/ldbc_snb_interactive/issues/173). Then, we'll adjust the Spark-based generator to produce a format that can be consumed by the SNB Interactive driver. Gabor