DiscourseDB / discoursedb-core

DiscourseDB Core Repository
GNU General Public License v2.0
10 stars 4 forks source link

Slow CSV import #29

Open cbogart opened 6 years ago

cbogart commented 6 years ago

The CSV importer loads all records in the file in one very large query, which gets slower as the query grows. Fix it to batch records on input. WORKAROUND: Break up import CSV file into thousand-record chunks and import them separately.