insightsengineering / formatters

A framework for creating listings of raw data that include specialized formatting, headers, footers, referential footnotes, and pagination.
https://insightsengineering.github.io/formatters/
Other
15 stars 6 forks source link

Add snapshot testing job #281

Closed cicdguy closed 3 months ago

cicdguy commented 3 months ago

Adds another R CMD check workflow that does non-CRAN checks and therefore executes snapshot tests.

github-actions[bot] commented 3 months ago

Unit Tests Summary

  1 files    8 suites   13s :stopwatch:  48 tests  48 :white_check_mark: 0 :zzz: 0 :x: 335 runs  335 :white_check_mark: 0 :zzz: 0 :x:

Results for commit 557e05fa.

:recycle: This comment has been updated with latest results.

github-actions[bot] commented 3 months ago

badge

Code Coverage Summary

Filename             Stmts    Miss  Cover    Missing
-----------------  -------  ------  -------  --------------------------------------------------------------------------------------------------------------------------------------------------------
R/format_value.R       194      12  93.81%   88, 105-112, 187, 296, 396, 407, 415
R/generics.R           118      10  91.53%   255-259, 461, 473, 504, 534, 642, 666-673
R/labels.R              55       7  87.27%   51, 57, 66, 107, 133, 142, 146
R/matrix_form.R        635      42  93.39%   102, 431-432, 511, 523-526, 544, 575, 664-665, 679-684, 714-717, 746-747, 777-778, 860-861, 888, 916, 967, 1123, 1159, 1162-1166, 1213, 1261, 1264, 1268
R/mpf_exporters.R      260      18  93.08%   2, 96-98, 143, 179, 220, 225, 402-408, 412, 415, 453, 548
R/page_size.R           45       1  97.78%   171
R/pagination.R         676      38  94.38%   300-303, 404-417, 502, 577, 768-769, 789-798, 990-991, 1174, 1180, 1259, 1389-1390, 1402-1403, 1417-1418
R/tostring.R           586      49  91.64%   40, 92, 162, 195, 203, 239, 296-299, 380-384, 387-390, 397-402, 479, 618-619, 684-691, 740-744, 828, 843, 936, 969, 1010, 1051, 1105, 1112
R/utils.R                3       0  100.00%
R/zzz.R                 17       6  64.71%   28-33
TOTAL                 2589     183  92.93%

Diff against main

Filename      Stmts    Miss  Cover
----------  -------  ------  --------
TOTAL             0       0  +100.00%

Results for commit: 557e05fa3e5e6eb9ef0737cca1adc212f924ef86

Minimum allowed coverage is 80%

:recycle: This comment has been updated with latest results

pawelru commented 3 months ago

TIL this: open run details -> scroll down to the bottom image

This will essentially present the difference of test scope between cran and non-cran type of checks. The expectation is that non-cran would have more or equal number of test cases because of cran skips (explicit ones plus also snapshot tests).