Closed GoogleCodeExporter closed 9 years ago
Doing bulk loads into the highly normalized stoqs database (inserts made to
several tables in each transaction) would entail a fair amount of work - and
really would duplicate a lot of what Django does.
Some code improvements have been made over the last year to reduce load times.
On my development VM I typically see 6-7 seconds for each 500 records.
Throwing a bit of money and database tuning at this problem has helped too.
This summer we are configuring MBARI's internal server "kraken" following
guidance in the book "PostgreSQL 9.0 High Performance" and with spinning disks
get load times of 5-6 seconds for each 500 records. We expect this to be much
better with the FusionIO drive.
Original comment by MBARIm...@gmail.com
on 24 Jul 2013 at 4:54
Having worked with loading data from several campaigns following the initial
posting of this issue we've determined that the current load times are
acceptable and are closing this issue.
Original comment by MBARIm...@gmail.com
on 24 Oct 2013 at 4:47
Original issue reported on code.google.com by
MBARIm...@gmail.com
on 25 Jun 2012 at 5:25