remove a unused index. Really reduce the db size (30% reduction, according to some tests)
create index after all the data is inserted: this lower both cpu & memory consumption
use in-memory database, so a single code path can be used. Plus, according to tests, it reduces by 70% the memory consumptions (really, from 1.6GB to 500MB!)
Hello Mark,
The major stuff in these commits are: