microsoft / DacFx

DacFx, SqlPackage, and other SQL development libraries enable declarative database development and database portability across SQL versions and environments. Share feedback here on dacpacs, bacpacs, and SQL projects.
https://aka.ms/sqlpackage-ref
MIT License
308 stars 19 forks source link

Performance - Align ImportTableBatchHelper BulkCopy BatchSize with Clustered Columnstore Index guidance #100

Open cmeyertons opened 2 years ago

cmeyertons commented 2 years ago

Is your feature request related to a problem? Please describe. Importing bacpacs is extremely slow and resource intensive.

Describe the solution you'd like In the ImportTableBatchHelper, the Batch Size is configure to int.MaxValue, while the guidance for Clustered Columnstore Index loading is 1048576 (Smart Bulk Copy respects this behavior)

Benjin commented 2 years ago

Thanks for reporting this! We'll take a look into this.