The current import script uses the Django data model. Since it needs to create and destroy many objects this way, it is slow. We should make a branch and try replacing this by SQL-statements.
We can keep the BD-creation from the Django model, which allows us to keep several consistency checks that the DB performs itself. Also, we can use the DB-connection via Django such that the import does not need to know which DB engine is used.
In combination with transaction, this should be much faster than the current import.
The current import script uses the Django data model. Since it needs to create and destroy many objects this way, it is slow. We should make a branch and try replacing this by SQL-statements.
We can keep the BD-creation from the Django model, which allows us to keep several consistency checks that the DB performs itself. Also, we can use the DB-connection via Django such that the import does not need to know which DB engine is used.
In combination with transaction, this should be much faster than the current import.