Closed moritzschaefer closed 6 years ago
Thanks for the feedback; I imagine other people will run into this as well. To avoid high memory usage we streaming-write individual prefix bins to disk while we create the target database. This means all of the bins have open file handles at that point. I think it should be pretty straightforward to buffer writing for each bin, which should eliminate this problem. Thanks for the report, I'll leave this open until it's fixed.
This should be fixed in release 1.7
When running the example in your README.md I get the following exception:
Increasing my open-files-limit from 4096 to 80000 solved the issue, though not everyone may have the option to increase the limit