gluent / goe

GOE: a simple and flexible way to copy data from an Oracle Database to Google BigQuery.
Apache License 2.0
8 stars 2 forks source link

For BigQuery we should consider copying primary key contraints #135

Open nj1973 opened 6 months ago

nj1973 commented 6 months ago

Primary key constraints are not enforced therefore there should not be a performance overhead when inserting. BigQuery documentation states:

" You should specify key constraints in the table schema when table data satisfies the data integrity requirements of primary key or foreign key constraints. The query engine can use the key constraints to optimize query plans. "

Although there is a counter argument that we do not do this for any other SQL engine, it is left up to the customer to apply constraints. So perhaps this is overstepping the mark.

I'm logging this for discussion in the future.