search

ldbc / ldbc_snb_interactive_v1_impls

Reference implementations for LDBC Social Network Benchmark's Interactive workload.
https://ldbcouncil.org/benchmarks/snb-interactive
Apache License 2.0
97 stars 85 forks source link

There is an empty directory for the factor generation of SF100 #392

Closed Ask-sola closed 1 year ago

Ask-sola commented 1 year ago

Hello, I generated data for SF1 and SF10 through "generate all. sh". However, when I tried to generate SF100, I found that it had some empty directories when generating factor: image image

Except for these two directories, there are parquet files under all other directories, which leads to subsequent parameter generation failures

This is obviously not normal, as other sizes or folders can be generated normally, except under SF100, the content in these two folders cannot be generated. If possible, I hope you can provide some help

GLaDAP commented 1 year ago

This can happen at the parameter generation if the script goes out of memory, resulting in empty directories. Could you verify if there is enough memory available during parameter generation?

Ask-sola commented 1 year ago

If this is a problem caused by insufficient memory, generally speaking, it will not interrupt the end of program operation and give an error message?The script I execute will only interrupt and stop when I find nothing in the person4Hop folder when generating parameters. image

I checked my memory and it seems that the capacity is still sufficient image

Ask-sola commented 1 year ago

Okay, this seems to be some problem with my computer. After restarting, it was successfully generated