failed to open/create index for wikidata hdt file file

rdfhdt / hdt-cpp

HDT C++ Library and Tools

117 stars 65 forks source link

failed to open/create index for wikidata hdt file file #202

Open ahmad88me opened 5 years ago

ahmad88me commented 5 years ago

It works with the HDT of DBpedia, but it stopped after some time. I open the HDT as follows: hdt = hdt::HDTManager::mapIndexedHDT(hdt_file.c_str()); I also copy the output.

Predicate Bitmap in 2 min 22 sec 128 ms 336 us
Count predicates in 46 min 14 sec 182 ms 540 us
Count Objects in 31 min 14 sec 235 ms 430 us Max was: 543914579
Bitmap in 48 sec 474 ms 86 us
Bitmap bits: 7230127313 Ones: 1190479283
make: *** [run] Killed: 9

dinikolop commented 5 years ago

Hi Ahmad! Did you run it on a server? Probably a sysadmin killed your run. Otherwise, possibly the kernel did due to memory + swap space gone.

ahmad88me commented 5 years ago

I ran it locally on my machine (maybe the OS killed the process), I had 8 GB ram. Is there a way/option to trade time and space (like a parameter or something like that?) @dinikolop

wouterbeek commented 5 years ago

8GB is probably too little RAM for Wikidata.