search

pyexcel / pyexcel-io

One interface to read and write the data in various excel formats, import the data into and export the data from databases
http://io.pyexcel.org
Other
58 stars 20 forks source link

bulk size is needed for sqlalchemy importer #40

Closed chfw closed 7 years ago

chfw commented 7 years ago

When pyexce.isave_as or isave_book_as is used, 36k piece of records were imported and it was designed so that the commit button was pressed at the very end. It also means that no data is seen in the db.

So, the idea is to call commit per 1k records or 2k via bulk_size parameter.