search

hubverse-org / hubValidations

Testing framework for hubverse hub validations
https://hubverse-org.github.io/hubValidations/
Other
1 stars 3 forks source link

Unclear error message -- where to look for more information about quantile crossing? #56

Closed elray1 closed 5 months ago

elray1 commented 8 months ago

I generated a model output file with quantile crossing 😅 and I got the following error message from running the validations:

! 2023-10-14-UMass-gbq_qr.csv: Values in `value` column are not non-decreasing as output_type_ids increase for
  all unique task ID value/output type combinations of quantile or cdf output types.  See `error_tbl` attribute
  for details.

My first thought was to look at

tmp <- hubValidations::validate_submission(
    hub_path="submissions-hub",
    file_path="UMass-gbq_qr/2023-10-14-UMass-gbq_qr.csv")
attr(tmp, 'error_tbl')

but this returns NULL. After a minute or two, I figured out that I should look at tmp$value_col_non_desc$error_tbl. Maybe we can provide a clearer description of this?