rust-lang / cargo

The Rust package manager
https://doc.rust-lang.org/cargo
Apache License 2.0
12.66k stars 2.41k forks source link

packaging: omit generated Cargo.lock if binaries and examples are package-excluded #11557

Open bromls opened 1 year ago

bromls commented 1 year ago

Problem

When running cargo package --no-verify --no-metadata -p <my_package>

Expected behavior: a generated Cargo.lock is produced for the package if and only if the package contains one or more examples or binaries.

Observed behavior: If the package has examples/**, but has marked the path as excluded (https://doc.rust-lang.org/cargo/reference/manifest.html#the-exclude-and-include-fields), a Cargo.lock is still generated despite the examples being excluded from the <package>.crate file.

Steps

No response

Possible Solution(s)

No response

Notes

This is admittedly an edge condition, but we have a CI flow where it is important to be able to avoid the Cargo.lock generation step. We are packaging multiple dependent crates from a workspace simultaneously for submission to an alternative registry with no API (direct registry index manipulation), so the failed registry lookups that occur during Cargo.lock generation break our ability to package the crates simultaneously.

We would not want to .gitignore the examples, as we want them there for developers of the crates. However, any other exclusion mechanism (if there are reasons not to overload https://doc.rust-lang.org/cargo/reference/manifest.html#the-exclude-and-include-fields) would be appropriate.

The workaround we currently use is to avoid examples inside publishing crates, instead putting them in separate crate(s) in the same workspace.

This is related to:

Version

cargo 1.65.0 (4bc8f24d3 2022-10-20)
release: 1.65.0
commit-hash: 4bc8f24d3e899462e43621aab981f6383a370365
commit-date: 2022-10-20
host: aarch64-apple-darwin
libgit2: 1.5.0 (sys:0.15.0 vendored)
libcurl: 7.85.0 (sys:0.4.55+curl-7.83.1 system ssl:(SecureTransport) LibreSSL/3.3.6)
os: Mac OS 13.1.0 [64-bit]
weihanglo commented 1 year ago

This piece of code controls the behavior you described sits here

https://github.com/rust-lang/cargo/blob/abc6abe34d28249a556ac17593a4951519b59f30/src/cargo/sources/path.rs#L153-L167

The fix might be simple. Call the clouse ignore_should_package(…) earlier, and inside fn include_lockfile(…) try to determine if target.src_path() is ignored. Then determine the reult from these two booleans.

To me, it seems quite hacky but actually reasonable, since the package doesn't include any example ro binary anymore. However, I've seen several counter proposals advocating that every package even a library only package should commit its Cargo.lock to VCS, specifically, #8728. I don't have an obvious answer at the time being.

ia0 commented 1 year ago

I'm either misunderstanding something, or there's a misunderstanding. My understanding is that:

For me, those 2 statements are not incompatible and that's what I expect from the following situation: