wmo-im / wis2-data-analysis

Apache License 2.0
0 stars 1 forks source link

inserting records is too slow: review options for bulk-insert #12

Closed maaikelimper closed 10 months ago

maaikelimper commented 1 year ago

Review code and advice how to implement bulk-insert

maaikelimper commented 1 year ago

Note, the delay might not be due to insert-time, but due to data-processing time, review how to process data in batches.

maaikelimper commented 10 months ago

dave worked with Chems and data is now processed using a messagequeue