Code-Inspect / flowr

A program slicer and dataflow analyzer for the R programming language.
https://github.com/Code-Inspect/flowr/wiki
GNU General Public License v3.0
14 stars 2 forks source link

Benchmark: compare reductions without comments and empty lines #797

Closed Ellpeck closed 1 month ago

codecov[bot] commented 1 month ago

Codecov Report

Attention: Patch coverage is 89.04110% with 8 lines in your changes are missing coverage. Please review.

Project coverage is 71.82%. Comparing base (d370560) to head (48698aa).

Files Patch % Lines
src/benchmark/slicer.ts 83.33% 2 Missing and 1 partial :warning:
src/benchmark/summarizer/first-phase/process.ts 92.68% 2 Missing and 1 partial :warning:
src/benchmark/stats/print.ts 33.33% 2 Missing :warning:
Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #797 +/- ## ========================================== + Coverage 71.74% 71.82% +0.08% ========================================== Files 201 201 Lines 7142 7192 +50 Branches 1099 1210 +111 ========================================== + Hits 5124 5166 +42 - Misses 1673 1679 +6 - Partials 345 347 +2 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

Ellpeck commented 1 month ago

This is now, for reference, a single run of the social science benchmark with the new reduction comparisons and input information:

[...]

  Reductions (reduced by x%):
    Number of lines:                             41.667% -         99.889% (median:         94.302%, mean:         92.673%, std:           6.63%)    
    Number of lines no auto:                     41.667% -        100.111% (median:         96.362%, mean:         94.733%, std:           6.63%)    
    Number of characters:                        16.872% -         99.986% (median:         94.404%, mean:         92.418%, std:            9.3%)    
    Number of non whitespace characters:         17.471% -          99.98% (median:         94.014%, mean:         92.196%, std:          9.212%)    
    Number of R tokens:                           8.324% -         99.945% (median:         92.796%, mean:         89.557%, std:         12.952%)    
    Normalized R tokens:                          4.836% -         99.928% (median:         92.497%, mean:          89.25%, std:         13.308%)    
    Number of dataflow nodes:                    11.659% -            100% (median:         95.272%, mean:         92.982%, std:         10.736%)    

  Reductions without comments and empty lines (reduced by x%):
    Number of lines:                               12.5% -         99.875% (median:         92.715%, mean:         90.708%, std:          8.091%)    
    Number of lines no auto:                       12.5% -        100.125% (median:         95.406%, mean:           93.4%, std:          8.091%)    
    Number of characters:                        16.872% -         99.985% (median:         94.113%, mean:         91.973%, std:          9.998%)    
    Number of non whitespace characters:         17.471% -         99.978% (median:         93.675%, mean:         91.704%, std:          9.942%)    
    Number of R tokens:                           3.904% -         99.944% (median:         92.628%, mean:         89.303%, std:         13.289%)    
    Normalized R tokens:                          3.718% -         99.928% (median:         92.473%, mean:          89.22%, std:         13.362%)    
    Number of dataflow nodes:                    11.659% -            100% (median:         95.272%, mean:         92.982%, std:         10.736%)    

[...]

Input:
  Number of lines:                                  28 -             923 (median:          246.58, mean:          246.58, std:               0)      
  Number of non empty lines:                        23 -             803 (median:          190.46, mean:          190.46, std:               0)      
  Number of characters:                            892 -           52508 (median:        10173.66, mean:        10173.66, std:               0)      
  Number of characters (w/o comments):             892 -           52169 (median:         9867.06, mean:         9867.06, std:               0)      
  Number of non whitespace characters:             745 -           37535 (median:         8110.78, mean:         8110.78, std:               0)      
  Number of n. w. c. (w/o comments):               745 -           37247 (median:         7846.16, mean:         7846.16, std:               0)      
  Number of tokens:                                317 -           12641 (median:         2584.34, mean:         2584.34, std:               0)      
  Number of tokens (w/o comments):                 312 -           12521 (median:         2533.82, mean:         2533.82, std:               0)      
  Normalized R tokens:                             173 -            6953 (median:         1447.14, mean:         1447.14, std:               0)      
  Normalized R tokens (w/o comments):              173 -            6951 (median:         1445.08, mean:         1445.08, std:               0)      

[...]
EagleoutIce commented 1 month ago

This pull request is included in v2.0.2 (see Release v2.0.2 (Fixing Control-Flow, Markdown-Exports, and Handling of Unnamed Closures)).