nodejs / corepack

Zero-runtime-dependency package acting as bridge between Node projects and their package managers
MIT License
2.36k stars 150 forks source link

`packageManager` field is too limited #402

Open GeoffreyBooth opened 4 months ago

GeoffreyBooth commented 4 months ago

The packageManager field as currently designed is too limited for what I want to do:

Seeing as this much complexity will require multiple configuration options, I suggest we retire the packageManager field and create a new corepack field that can contain a configuration object with all the necessary fields to cover the various permutations described above.

@nodejs/corepack @nodejs/loaders @nodejs/npm @nodejs/package-maintenance

arcanis commented 4 months ago

This issue is about several independent feature requests ("I want to use different package managers on different commands", "I want to specify what happens when the version mismatches"). The packageManager field itself has no impact on those, and it makes little sense to start the discussion from that.

Can you close this thread and open dedicated ones for each of those two use cases?

GeoffreyBooth commented 4 months ago

The request is that I want more configuration options for Corepack. Specifically, these are the things I want to be able to configure. I can split it into multiple issues, but I think these all go together (many of these ideas are current features of the engines field) and the question is really “what use cases do we want to support” which would lead to an update of the design doc (#401).

aduh95 commented 4 months ago

packageManager is not a replacement for the engines field, its goal is more narrow (and that’s probably a good thing)

GeoffreyBooth commented 4 months ago

is not a replacement for the engines field

It should be. The engines field can't do some of these things, and for the parts that overlap there should be a clear precedence rather than the two being mixed.

GeoffreyBooth commented 4 months ago

its goal is more narrow

Where is the goal defined?

aduh95 commented 4 months ago

its goal is more narrow

Where is the goal defined?

https://nodejs.org/api/packages.html#packagemanager

GeoffreyBooth commented 4 months ago

All that says is "The "packageManager" field defines which package manager is expected to be used when working on the current project." Are my use cases in scope or out of scope? You're saying its scope is limited but I don't see a limiting principle here.

styfle commented 4 months ago

Cross linking this other comment from GeoffreyBooth since it has a suggestion how to implement:

I do wonder if we are going to hit a wall in the future trying to shove everything into one string.

We already have several things defined in one string today: name, version, hash

wesleytodd commented 4 months ago

I mean this field is already not enough to define what we need to properly develop a project because it doesn't include what node version you should develop with. IMO trying to fix packageManager is the wrong course and we should deprecate it and move to a more holistic approach to binary management which is more generic to account for the many requirements real projects have.

I know my comment is derailing this issue, but I think it is a big waste of everyone's time to push forward on a bad plan.

GeoffreyBooth commented 4 months ago

I do wonder if we are going to hit a wall in the future trying to shove everything into one string.

💯

Or more to the point, it’s too limiting. Maybe we might never want to implement #406, where we can define different package manager possibilities based on operation (or maybe say that we want Corepack validation to apply only to operations that affect lockfiles) but if we’re limiting ourselves to just a single string, it’s awfully hard to potentially someday add such a feature. (Sure, the string could be stringified JSON, but that’s just ridiculous 😄) Or if we want to implement #405, mimicking npm’s engines.strict; I can easily see that being a feature that users want.

Better to shift to something new now, before we’re enabled by default and stable. I like top-level "corepack", or another option is engines.packageManager; in either case, the value would be an object that can continue expanding as we add more options.

GeoffreyBooth commented 4 months ago

It looks like the npm team is interested in collaborating on whatever this new configuration would be: https://github.com/nodejs/node/issues/51888#issuecomment-1967141092.

So maybe we don’t name it corepack; we can decide the name later. But I think let’s open this up and define something in collaboration with them, so that hopefully we can spec out something that both Corepack and npm can support, so that from the user’s perspective npm is compatible. Does that work for you @styfle @arcanis @aduh95 ?

Lectem commented 1 week ago

Just wanted to note that corepack now sets the field by default which will definitely be an issue as soon as more people start using it. If packageManager needs to change in (a near) future this needs to be reverted (see corepack issue https://github.com/nodejs/corepack/issues/485 )

legobeat commented 1 week ago

I think a lot of the the friction here would be resolved by supporting semver ranges? Already open issue: