Experts analyse the outputs of tests and compare them to a reference, according to various metrics depending on the type of test.
Some experts would benefit from improvements, some new experts addressing aspects not cheched at the moment should be developped:
To be improved:
pack2bin (gmkpack): retrieve path to gmkpack outputs when build fails ? to be printed in the stdout of the terminal ? (not sure it is possible)
fields: scatter plots or histogram of errors if normalized RMSE > threshold ? link with tecpaf/F.Suzat
fields: too slow on Arpege T798 for instance (cf. 3rd bullet in #34)
DrHook: how to make it more reliable (at the moment way too volatile)
New experts:
DDH: epygram is able to read DDH files and could compare DDH outputs
EC_MEMINFO: in replacement of the RSS expert, get more information from EC_MEMINFO
Coding norms checker: for routines modified in branch, get norms checker outputs and set a "score": 0 if no improvement in norms checking violation, positive if some improvement, negative if introducing new violations. How to use the norms checker out of the box (Ryad) ?
Experts analyse the outputs of tests and compare them to a reference, according to various metrics depending on the type of test. Some experts would benefit from improvements, some new experts addressing aspects not cheched at the moment should be developped:
To be improved:
New experts:
EC_MEMINFO