Currently a large chunk is allocated as buffer for index write in order to support both single file xml input and tar.gz input. But the large chunk might not be enough. It would be better to have a temporary buffer which is flushed whenever it gets full. Test the performance difference between this and writing straight
vkitchen
commented
1 year ago
Currently a large chunk is allocated as buffer for index write in order to support both single file xml input and tar.gz input. But the large chunk might not be enough. It would be better to have a temporary buffer which is flushed whenever it gets full. Test the performance difference between this and writing straight