search

prooph / link

Automated Workflow Processing
BSD 3-Clause "New" or "Revised" License
13 stars 1 forks source link

Sqlconnector: Improve import performance #36

Closed codeliner closed 9 years ago

codeliner commented 9 years ago
  1. Use a single transaction for import
  2. Use same prepared statements accross import
  3. Don't use update mechanism whenever possible. Instead delete the affected datasets and insert them again. Provide ability to specifiy the fields to use to identifiy deletable records.
codeliner commented 9 years ago

1 and 2 was already implemented and 3 is now done: https://github.com/prooph/link-sql-connector/commit/a56d3616a356fbd65370106c565f1e5803ed3251