dfinity / sdk

IC SDK: a Software Development Kit for creating and managing canister smart contracts on the ICP blockchain.

https://internetcomputer.org/developers

Apache License 2.0

170 stars 82 forks source link

perf: improve sync command performance #3766

Closed olaszakos closed 3 months ago

olaszakos commented 3 months ago

Description

This PR has the following changes:

Make chunk creation faster, by increasing parallelization 4=>25, improves performance significantly for lots of small assets
Make asset properties query faster by parallelization (major time save for canisters that have a ton of assets, the internetcomputer.org canister has 11k+ assets)
icx-asset: Support log levels, and default to info

How Has This Been Tested?

I have not added any new tests, we are using this already with icx-asset sync for dfinity/portal PR preview deployments.

Deployment time has gone down from ~40m to <10m.

Checklist:

[x] The title of this PR complies with Conventional Commits.
[x] I have edited the CHANGELOG accordingly.
[ ] I have made corresponding changes to the documentation.