Cambridge-ICCS / ONEFlux

Open Network-Enabled Flux processing pipeline
Other
0 stars 0 forks source link

Add regression test cases #22

Closed j-emberton closed 2 months ago

j-emberton commented 3 months ago

Added a selection of regression test cases supplied by Gilberto.

Cases selected to generate 'maximum' number of error reports, with minimum actual tests. Evaluation is summarised in screen cap of excel file. Hopefully this avoids us needing to use an external file storage system to host the test case data. Git LFS is a non-starter due to it being a fork of an open repo.

All tests pass.

j-emberton commented 3 months ago

Plan to rebase to master shortly

j-emberton commented 2 months ago

Summary of what cases declare what messages in their respective report files

Screenshot 2024-09-10 at 10 34 10
dorchard commented 2 months ago

Summary of what cases declare what messages in their respective report files

Screenshot 2024-09-10 at 10 34 10

That's great. Can we serialise this in a textual format and put it with the tests? Otherwise I think this is all good to be merged.

j-emberton commented 2 months ago

@dorchard have added a txt summary above the test case list. Is this what you had in mind?