Our testing framework so far has been only for one test case buckner40/004 but we need to start pushing more cases through.
Decided to keep part 1, 2 and 3 to make debugging easier. We will integrate it into one script once we are satisfied with the numerical results.
Defined a test case as a subdirectory inside the buckner40 directory. There are 40 test cases.
MATLAB should write out fixtures to a directory called buckner40/<test_case_dir>/matlab_checkpoints. At the minimum, we need to write checkpoints named part 1, part 2, and part 3 cooresponding to the three fixtures used by the three samseg parts. However, more checkpoints should be written wherever we think it can aid in debugging and testing.
Python should also write out checkpoints similar to how MATLAB does. This needs to be implemented. It should write out checkpoints to a directory called buckner40/<test_case_dir>/python_checkpoints.
A script needs to be written that given two checkpoint directories (python_checkpoints and matlab_checkpoints), it will identify differences to aid in debugging.
Our testing framework so far has been only for one test case
buckner40/004
but we need to start pushing more cases through.buckner40
directory. There are 40 test cases.buckner40/<test_case_dir>/matlab_checkpoints
. At the minimum, we need to write checkpoints named part 1, part 2, and part 3 cooresponding to the three fixtures used by the three samseg parts. However, more checkpoints should be written wherever we think it can aid in debugging and testing.buckner40/<test_case_dir>/python_checkpoints
.python_checkpoints
andmatlab_checkpoints
), it will identify differences to aid in debugging.