w3c / process

W3C Process Document
https://www.w3.org/policies/process/drafts/
192 stars 129 forks source link

Should member submissions be removed from the Process? #648

Open frivoal opened 2 years ago

frivoal commented 2 years ago

As suggested by @michaelchampion in https://github.com/w3c/w3process/issues/639#issuecomment-1255394173

@michaelchampion :

Does the concept of a "member submission" still belong in the Process, considering the evolution of the patent policy, the near-universal use of "forkable" copyright licenses in web standards, and the use of community groups as the typical incubation mechanism? It would seem cleaner to just remove member submissions to the process than try to untangle the Director from yet another corner case.

@dwsinger :

The history suggests that they remain an active tool.

@michaelchampion :

Well sure, if you expose a lever, people will yank on it. Are they doing anything with that lever they couldn't do if it were removed? Is repairing the mechanism the lever controls worth the trouble, considering you could just remove the lever?

@jeffjaffe :

As per the history that David cites, it has been useful particularly to get input from industry groups.

@michaelchampion :

Again, what input are you getting via the submission process you couldn't get from normal participation in WGs, IGs or CGs?

I know from personal experience the Member Submission process was abused in the past to get the appearance of W3's imprimatur on "input from industry groups" that had no broad industry support or prospects of getting into a Recommendation. I don't know of that happening in the last 10 years or so, but I don't see many submissions that had a real impact since the FIDO submission in 2015 either.

This is a pretty minor nit in the Process so I don't really care what happens to this issue, but I am concerned that the Process is accreting ever more complexity to cover anachronistic corner cases. Assuming W3C survives the LE transition and the AB can focus on process and community issues next year, cleaning up this sort of legacy cruft might be worth some attention.

@mnot:

I tend to agree with Michael here - member submissions made sense pre-CG, much less so now.

@michaelchampion:

I proposed resolving the issue of how to appeal member submission decisions by removing member submissions🤷

If I have an issue with my appendix or gall bladder, my doctors won’t spend time trying to fix it, they will resolve the issue by removing the problematic organ.

@palemieux:

@michaelchampion Say a group of folks that a not W3C members come up with a spec, and would like to continue the work in W3C, how would they get started?

@michaelchampion :

Create a Community Group; have the CG publish the spec with an open copyright license and patent commitments from the contributors; build a community of users who have problems the spec solves, implementers who will support the standard in their products, tools, frameworks, etc.; then draft a charter for a new WG or discuss expanding the charter of an existing WG to put the “incubated”spec in scope.

@palemieux:

Is there any way for the contribution, with the relevant patent commitments, to be directly accepted by a WG?

@michaelchampion:

I don't see why not, but I haven't thought about this for a while. If someone writes a spec, joins a WG for which it is in scope thus making patent commitments to anything the WG takes to Rec, proposes it and the WG accepts it, I don't foresee any problems.

Member submissions historically were for situations where there wasn't an existing WG with the spec in scope, and before there were CGs with a patent policy designed to cover such incubation scenarios.

To be clear, I don't have strong feelings on whether member submissions should be removed from the process. I'm just suggesting the Process CG convince themselves that member submissions are worth fixing to work in a director-free world as opposed to just removing them from the Process so this issue doesn't arise.

palemieux commented 2 years ago

As suggested by @michaelchampion, a member submission could be considered by a CG or WG no differently than any member contribution, with the exception of the requirements specified at Licensing Commitments in W3C Submissions.

michaelchampion commented 2 years ago

The licensing commitment is another anachronistic feature of Member Submissions ... .

must indicate whether or not each entity (Submitters and other licensors) will offer a license according to the W3C RF licensing requirements for any portion of the Member Submission that is subsequently incorporated in a Patent Review Draft or Recommendation. The W3C Team may acknowledge the Member Submission if the answer to the licensing commitment is either affirmative or negative,

Why should W3C perpetuate process features that don't require RF patent commitments on contributions?

palemieux commented 2 years ago

@michaelchampion do other parts of the process or the patent policy cover the situation where a contribution is the result of the work of many outside of W3C?

Sometimes work starts within an industry group, who later realizes that the work has broader utility and would be best standardized through an organization like the W3C. It would be be good to have a way for such work to be provided as input into the W3C process.

(edited with additional details)

frivoal commented 2 years ago

While member submissions aren't used terribly much, there are cases for which it isn't clear to me that there's a better replacement.

Say you have a file format, which is a de-facto standard without published documentation. As something that is already broadly used, unless there's a will to make a next version with more features, there's not much point in spinning up a WG (or even a CG) to discuss how it ought to be, that's already settled by usage. But it could still be convenient for the company that made it to share the documentation for that format, along with information of what patent regime it is under.

A member submission would seem to me to be a very appropriate way of sharing that. Members submissions aren't limited to this case, but they seem to me to be the only W3C process that's adequate for handling that sort of situation.

For instance, see this note from https://www.w3.org/TR/css-ui-3/#cursor:

Note: At the time of writing this specification (spring 2015), the only file formats supported for cursors in common desktop browsers are the .ico and .cur file formats, as designed by Microsoft. For compatibility with legacy content, UAs are encouraged to support these, even though the lack of an open specification makes it impossible to have a normative requirement about these formats. Some information on these formats can be found on Wikipedia.

I'd say that it would be a nice thing for Microsoft to release the documentation for these formats as a member submission, and it isn't entirely clear to me that any other W3C path to publication that would be suitable.

As for the patent regime, I'd surely prefer it to be RF, but what if, due to historical reasons on how the format was created, it cannot be? It might still be preferable to have documentation for the format and information about what patent regime it is under, than be left in the dark entirely.

It could still be true that the cost of having and maintaining this system exceeds any benefit it may have. I am not sure I have that strong an opinion about that yet.

michaelchampion commented 2 years ago

But it could still be convenient for the company that made it to share the documentation for that format, along with information of what patent regime it is under.

Sure in 1995 or whenever the Process was defined, that might have been a valuable use case. But In a world where GitHub, Microosft/Google docs in the cloud, very low cost web hosting solutions, etc. etc. etc. exist why should W3C invest in sharing unvetted documents with the world? And if the answer is "submissions ARE vetted by the Director" then we have to address #639 and figure out how to get them authoritatively reviewed by someone else. Is it worth it -- to the people maintaining the Process, those who will have to do the reviews, and the community trying to understand the Process -- for the various corner cases that Submissions once addressed be supported in the future?

It could still be true that the cost of having and maintaining this system exceeds any benefit it may have. I am not sure I have that strong an opinion about that yet.

Right. I don't have a strong opinion, but the complexity cost seems to outweigh any benefit I've heard in this thread and #639.

frivoal commented 2 years ago

why should W3C invest in sharing unvetted documents with the world?

Possible reason: because these are about technologies upon which we have dependencies, whether we like it or not, and having them documented at a location which is guaranteed to be stable into the foreseeable future, along with a requirement for explicit documentation of patent licensing is preferable to having the same information hosted somewhere that might go 404 in 3 years, and for which there is no requirement of documenting the patent licensing.

All in all, I find marginal utility in the availability of member submissions. But they don't seem terribly important either.

dwsinger commented 2 years ago

Note that some sort of disclosure/publication process for specs that are relevant in the space is not completely unheard of. SMPTE has Registered Document Disclosure, for example; IETF has individual-track RFCs.

Perhaps it would be good to encourage more use of this, so relevant vendor specs that materially impact our field are published this way? I'm not keen on spending a lot of time on either promoting this vehicle nor shutting it down, right now, though.

mnot commented 2 years ago

The Independent Submission Stream for RFCs isn't part of the IETF -- it's a separate stream with an editor (who is selected by the IAB).

That might get to the heart of why I'm wary of member submissions -- they have a smell of 'pay to publish' without any editorial oversight. In the past I've heard of them being used as an enticement to membership.

Right now, s 10 puts the decision to acknowledge in the hands of the Team without any guidance (beyond making sure the request is 'complete'). It might be better to put that decision in other hands, or at least to provide more guidance about what the purpose of member submissions are, and therefore what the criteria for their acceptance is.

TallTed commented 2 years ago

I've not heard of any past instance where a Member Submission was blessed as a TR, instantly or otherwise, without being processed through at least a year — if not 2–4 or even more — of some IG/XG/CG/WG/whateverG(s) and being treated (mostly) the same as any other input document for that group's work.

I have heard of a few (and been in such groups) where a Member Submission was published as a (no longer a thing?) First Public Working Draft of (one of) their anticipated final document(s) upon ratification by group membership, and bore some but far from complete resemblance to the final document(s) that went into CR/PR/TR.

I can see some potential for membership enticement there, as I would expect it easier to get such a thing taken up as an input document when submitted by a member (so join!), not only but significantly because of the Patent Policy, which I think I remember takes effect upon such a Member Submission (differently than when a WD/FPWD/CR/PR/TR is produced entirely by the CG/XG/IG/WG/xG), than when submitted by a disconnected and apparently disinterested party (so why are you submitting to W3C?)... but I don't think this is any different than would be an available potion to any other member; this seems to me just "and don't forget, when you're a member, you can make a Member Submission to accelerate pre-WG (IG/XG/CG) work."

frivoal commented 6 months ago

There has been no member submission since 2020. I've changed my mind, and no longer think that this part of the Process justifies its continued existence based on some marginal benefit, even in a simplified form as proposed in https://github.com/w3c/w3process/issues/421.

It seems to me that it is in everyone's interest to keep the Process short enough that it is approachable to new comers (Member companies and individuals). As we grow various parts of it in response to new needs, we should also be willing to retire obsolete parts, lest we force anyone diligent enough to try and learn the process to read pages worth or irrelevant rules and concepts.

I think we should simply delete from the Process the entire Member submission section and subsections. This would not prevent the Team for offering a "we'll host your document if it seems valuable" service and document it whereever they want (/Guide?), but I don't think keeping it as a right of members with formal processes around it is relevant anymore.

nigelmegitt commented 6 months ago

My sense is that the member submission process came out of a need, and even though that might be rarely used nowadays, I think the need probably does still exist. Before removing it, I think we need to understand what the expected model would be for a member to bring pre-existing work into W3C for use as the basis of a new Recommendation, and how issues like IPR would be handled. Perhaps there is a simpler alternative that does not require much, or any, spec text, but given that we don't have a proposal yet, I'd prefer to take no action, around the section as a whole.

One area that might incur maintenance costs now is the one about rejection and appeals - I can imagine that refactoring that in terms of a Team Decision might simplify things a bit. I can't see a rationale for a whole separate Submission Appeals process now that we have Team Decision, assuming we can restrict visibility of such team decisions to the Team and the Submitter.

frivoal commented 6 months ago

My sense is that the member submission process came out of a need

Yes, but that predates CGs. Now, that's a much more common way to bring work to W3C.

how issues like IPR would be handled

Member submissions require you to disclose what your IPR is, but it doesn't require any favorable regime. Submitting something to a CG gives us more than that.

I can imagine that refactoring that […]

Something like that used to be my preferred approach. I no longer think it's worth the effort.

Before removing it

Note that I'm not necessarily saying we should discontinue the service. The Team could absolutely continue having this capability, and documenting how to submit things elsewhere (/Guide ?), which could be more focused on why you might want to do that, rather that the right and duties of various people. The Team provides IRC channels and all sorts of things without the being mandated by the Process. What removing it from the Process does is that it would no longer be a guaranteed right, letting us get rid of the even more unused appeals process, and no longer inflecting it on unsuspecting people.

frivoal commented 5 months ago

Note: closing this issue as proposed (with a removal of the Member submissions process) would also allow us to close: #639, #442, #421, #714.

dwsinger commented 5 months ago

Perhaps I am opening a can of worms, but SMPTE clearly distinguishes the status of a member submission from work initiated and done at the consortium. They call theirs "Registered Disclosure" and say that at least one of the purposes is to provide the opportunity for members of the community to document practices that affect the industry and deserve public documentation, without any implication of endorsement by SMPTE.

css-meeting-bot commented 1 month ago

The Revising W3C Process CG just discussed Should member submissions be removed from the Process?, and agreed to the following:

The full IRC log of that discussion <fantasai> Subtopic: Should member submissions be removed from the Process?
<fantasai> Github: https://github.com/w3c/process/issues/648
<fantasai> florian: People complain that the Process is too long. Most of the text needs to be there, but some of it maybe can be removed.
<fantasai> florian: Member Submissions seem like that kind of thing.
<fantasai> ... They don't need to be in the Process, really.
<fantasai> ... Team could retain ability to put stuff on the W3C Website
<fantasai> ... Putting these in the Process guarantees the right to make a Member Submission
<fantasai> ... ~4 pages of text, seems like a lot for what it does
<fantasai> florian: Once upon a time, this was how you started work at W3C. But CGs largely make this redundant.
<fantasai> ... One thing that makes Member Submissions interesting is that Members are required to say whether they would license relevant patents
<fantasai> ... Not sure we need to keep this, suggest to delete this section.
<fantasai> plh: If we remove from Process, no longer guaranteed. Up to Team what they do about it.
<fantasai> ... I would be ok with moving to Guide
<fantasai> ... but would want to ask others about it
<fantasai> florian: We could simplify the section. Say that you can do this, Team says how you do it.
<TallTed> q+
<fantasai> ... there's a lot of formalism about it
<fantasai> plh: We would want to keep the formalism. We've had situations [missed]
<fantasai> ... if it moves into Guide, becomes responsibility of the Team
<florian> s/Team says how you do it./Team says how you do it. The current formalism is very heavy
<fantasai> plh: Member Submissions is a Member right, so unsure.
<plh> ack ted
<fantasai> TallTed: my experience of Member Submissions is that historically they were a way to skip a level of incubation and proceed directly to a WG.
<fantasai> ... not so much being used as a turf declaration, although that is an aspect of it
<fantasai> ... Member Submission becomes a tacit admission that this is a valid way to handle a thing, rather than just spitballing
<fantasai> ... I don't know that they're completely useful today given CG
<plh> q?
<fantasai> ... but also not sure they're entirely useless
<plh> ack tall
<fantasai> ACTION: plh to ask around about removing Member Submissions
<cwilso> q+
<fantasai> florian: The maintenance cost isn't very high. Mainly changed only by e.g. introduction of the Council
<fantasai> ... but there's the cost on the readers, makes Process longer
<fantasai> fantasai: What if we move most of the formalism to Guide, and just keep the minimal bits in the Process
<fantasai> ... like the patent commitments, and which decisions can be objected to, etc.
<tantek> q+
<plh> ack cwilso
<fantasai> florian: Note that Member Submissions are mentioned in the Patent Policy
<fantasai> cwilso: I'm in favor of just dropping Member Submissions as a thing.
<fantasai> ... don't seem to add anything over what you can do in a CG
<fantasai> ... and despite the text saying that publication implies no endorsement, probably is taken that way
<plh> ack tantek
<fantasai> tantek: I have actually some experience with this
<fantasai> ... when Social Web WG formed, there were a number of submissions by organizations offering in theme of "please base on this work / be compatible with this work"
<fantasai> ... these submissions were all offered royalty-free
<fantasai> ... none of those organizations participated in the WG
<fantasai> ... the effect the submissions had was a whole bunch of IP that those submissions covered were given to the WG
<fantasai> ... E.g. OpenSocial was submitted, it was huge across many companies
<plh> q+
<fantasai> ... idk if it impacted specs, but it gave people some level of confidence and less fear that the stuff we were designing / speccing would overlap with existing IP
<fantasai> ... idk if that's worth keeping the whole section of Process, but that was a positive use of Member Submissions
<plh> ack fantasai
<fantasai> ... idk how often it occurs, but having Members who aren't interested in participating in WG but want to enable them to build on their work, it's useful
<plh> fantasai: we don't have to remove Member submissions. we could narrow it down to what really needs to be there and push the rest in the Guidebook
<fantasai> florian: so we keep that it exists, patent policy applies, any disagreements get kicked to council
<tantek> +1 fantasai, florian
<fantasai> plh: ok with me
<fantasai> plh: Sometimes easier to do a Member Submission than spin up / join CG
<fantasai> ... for the purpose of providing IP
<tantek> +1 plh agreed, it was easier for these orgs to do the Member Submissions than join the IG/WG (and get review for that)
<fantasai> florian: OK, so we have an action item to replace the text with something minimal and push the rest to Guidebook
<fantasai> ACTION: florian and fantasai to create minimal Member Submissions section and push non-critical text to Guide
<plh> https://github.com/w3c/Guide/blob/main/process/member-submissions.html