Check if different tools give the same results

SoftengPoliTo / SoftwareMetrics

2 stars 0 forks source link

Check if different tools give the same results #18

Closed d-ver closed 4 years ago

d-ver commented 4 years ago

We must implement a TEST mode (argparse ...) to check if different tools return the same results for the metrics they have in common.

This mode should produce a separate Json output file for each of the used tools.

[x] SLOC (rust-code-analysis, tokei)
[x] LLOC (rust-code-analysis, tokei)
[x] CC (rust-code-analysis, lizard, CCCC)
[x] Halstead (rust-code-analysis, Halstead)

lu-zero commented 4 years ago

We must. Not should. :)

Please update the issue with a checklist per-tool.

d-ver commented 4 years ago

The idea is to make a python script that deletes the uncommon metrics between the confronted outputs, which are then compared with Json-diff. In this case, the Json files produced by this new script must not contain any empty metrics.

lu-zero commented 4 years ago

Would be better to just extract the single metric we want to test and compare it.

Luni-4 commented 4 years ago

Thanks for opening this issue @m51galaxy!

As @lu-zero said, we could implement these tests through a Python script that, instead of cleaning up a json file, extracts the metrics we are interested in from the json files produced by the tools and compares all of them in order to verify if they are identic

It's much simpler than our initial approach :)