The dataimport.py should have an option to remove database indices, process a file (or a set of files) and then build the indices again.
For big files or large number of files, this approach can be faster than adding rows and changing indices automatically.
The dataimport.py should have an option to remove database indices, process a file (or a set of files) and then build the indices again. For big files or large number of files, this approach can be faster than adding rows and changing indices automatically.