istopwg / ippeveselfcert

IPP Everywhere Printer Self-Certification Tools
https://www.pwg.org/ipp/everywhere.html
Apache License 2.0
21 stars 6 forks source link

IPP Everywhere Printer Self-Certification Results #97

Closed jacobsb closed 1 year ago

jacobsb commented 1 year ago

Please see attached 2 results for self certification: Lexmark MX632adwe.json.zip Lexmark CX635adwe.json.zip

michaelrsweet commented 1 year ago

Thanks, looking at these JSON files it looks like you might have used an old ippevesubmit to generate them? Still complains about the mismatch in the number of tests so you had to use the --override option:

/* Note: submitted with --override */
/* IPP errors:
Wrong number of tests (got 51, expected 41).
*/
/* Document errors:
Wrong number of tests (got 65, expected 53).
*/
jacobsb commented 1 year ago

Thanks, looking at these JSON files it looks like you might have used an old ippevesubmit to generate them? Still complains about the mismatch in the number of tests so you had to use the --override option:

/* Note: submitted with --override */
/* IPP errors:
Wrong number of tests (got 51, expected 41).
*/
/* Document errors:
Wrong number of tests (got 65, expected 53).
*/

Yes, there is a significant delay between when we run the tests internally and when we submit the results to the PWG. What we typically do is run and pass the tests while the product is nearing the end of the development phase but we cannot submit the results until the products are publicly announced by our company.

michaelrsweet commented 1 year ago

OK, thanks for the explanation.