search

M4SS-Code / cargo-goggles

Verify that registry crates in your Cargo.lock are reproducible from the git repository
https://crates.io/crates/cargo-goggles
Apache License 2.0
36 stars 2 forks source link

Parallelization #27

Closed paolobarbolini closed 3 months ago

paolobarbolini commented 3 months ago

Closes #27

paolobarbolini commented 3 months ago

This took 9 minutes on https://github.com/M4SS-Code/cargo-goggles/issues/11#issue-2218689544 with repositories already checked out and 64 rayon threads

VorpalBlade commented 3 months ago

This took 9 minutes on #11 (comment) with repositories already checked out and 64 rayon threads

How much faster was it than before? (E.g. how does it scale)

paolobarbolini commented 3 months ago

On current main analyzing the top 100 crates from scratch takes 212 seconds, on this branch it takes 100 seconds. The bulk of the time is now spent on the windows crates, which because of the shared workspace and repository clone don't currently allow parallel git checkouts to be done.