Based on some performance testing (here), I have added an 'adaptive' import option. That will check if parallel import is 'worth it' in that case.
Useful when having multiple imports going, with varying document count.
This is still a work in progress, would like your opinion if this is even something that should be added, or should just be kept under the same '--parallel' option.
Things to do:
Check Queue::size of the parallel-import queues, if they are full or currently handling another import - disable parallel import.
More performance testing, as the number of documents where parallel import is faster than regular could vary.
Based on some performance testing (here), I have added an 'adaptive' import option. That will check if parallel import is 'worth it' in that case.
Useful when having multiple imports going, with varying document count. This is still a work in progress, would like your opinion if this is even something that should be added, or should just be kept under the same '--parallel' option.
Things to do: Check Queue::size of the parallel-import queues, if they are full or currently handling another import - disable parallel import. More performance testing, as the number of documents where parallel import is faster than regular could vary.