search

googlefonts / fontbakery-dashboard

A library-scale web dashboard for Font Bakery, no longer developed
Apache License 2.0
28 stars 10 forks source link

Font Bakery Result mismatching numbers #122

Closed vv-monsalve closed 5 years ago

vv-monsalve commented 5 years ago

The Font Bakery Result shows different numbers between the summary and the details on the report (once clicking for details). These numbers are also different from the ones resulted on last QA run by command line.

Alata process Last QA5 run from the command line

Summary:

Screen Shot 2019-09-04 at 13 51 30

Clicking to see details:

Screen Shot 2019-09-04 at 13 51 55

Command line

Screen Shot 2019-09-04 at 16 54 55

vv-monsalve commented 5 years ago

Checking it again, I realize now that the Fail reported is on "Family" regarding the Designer information, which was solved by adding it on the Dashboard Spreadsheet. But, there is also a Warn about ftxvalidator is not available. FB report Process ID

graphicore commented 5 years ago

Thanks for reporting.

The results between the summary and the detailed report are the same, but your screenshot only shows the results for just the file, not the "Family Checks".

ftxvalidator is indeed not available, because we don't have access to Mac OSX servers, that's well known.

The "Designer" field, if not in the spreadsheet, should come from the METADATA.pb in github google/fonts master but the family is not there yet. In general it is very good when the info is in the spreadsheet, as we create a single source of truth for this kind of information.

Not sure about the different number of results between your CLI and the online version, could be many things.