opencontainers / oci-conformance

OCI Conformance/Certification Working Group
https://conformance.opencontainers.org
Apache License 2.0
72 stars 43 forks source link

How do we motivate people to do peer verification? #15

Closed RobDolinMS closed 2 years ago

RobDolinMS commented 7 years ago

A few ideas mentioned:

RobDolinMS commented 7 years ago

Would a minimum threshold for a product team seeking peer verification to verify two other products be sufficient?

In a perfect/complete world, this would mean that any certified product would have been reviewed by at least two peers.

hkamezawa commented 7 years ago

Two peers sounds good but wait-for-review may cause starvation while people tend to have promise of shipment date to customers. So, I think we need some visualization like Kanban and some agile method (rules for the team) to run the team. Can LF provide a scrum master ?

stephenrwalli commented 7 years ago

I was trying to consider this from an "abusive" perspective. Company A runs the tests and publishes results and awaits peer review. I think if it lags at all, Company A should be able to complain loudly to the Linux Foundation, OCI Trademark Board, Cert Working Group, or all of the above. I don't think we need to define a process at present, but this feels like a self-correcting problem from that perspective.

If Company A runs the tests and publishes results and Company B contests the results in some manner, then Company A can again encourage another review or complain to the LF. If Company A was forcing a result (attempting an overly relaxed interpretation), then subsequent reviews from Company C will either support Company A or B and create enough of a question to force it back to the Cert Working Group. It then falls to the Cert Working Group to correct the problem. Again, I don't think this requires process yet. Even if there's collusion between bad actors, sooner or later a good actor will call the question and force it back onto the Linux Foundation, OCI Trademark Board, Cert Working Group.

jdolitsky commented 2 years ago

Going to close as outdated. Please re-open if more discussion necessary.