search

greenlion / warp

WarpSQL Server, an open source OLAP focused distribution of the world's most popular open source database bundled with OLAP performance related plugins such as the WARP storage engine..
http://warpsql.blog
Other
41 stars 2 forks source link

Improve unique index check performance by scanning for duplicate key values in batches of inserts #27

Closed greenlion closed 2 years ago

greenlion commented 4 years ago

When a multi-value insert (or load data) writes data to a table, the inserts are cached in a ibis::tablex object up to a maximum size. Unfortunately it is not possible to query tablex objects, they are only for appending data, so insertions of duplicate keys in an individual batch can not be detected easily. Find a way around this to improve insertion performance with UNIQUE/PRIMARY keys.

greenlion commented 3 years ago

Probably will end up with fronting row store to fix this.

greenlion commented 2 years ago

constraints are no longer supported in WARP