The collection of tasks defined below should be all that is needed to prepare the tests that will determine if the grfn2gromet branch to merge into master. All tasks defined should be carried out on the grfn2gromet branch or a branch from that branch.
Full pipeline script: scripts/model_assembly/py2grfn.py
Tasks
Write a script that will auto-generate the test stubs for tests/program_analysis/test_python2cag.py, tests/program_analysis/test_cag2air.py, tests/model_assembly/test_air2grfn.py, and tests/model_assembly/test_grfn2cag.py for all of the Python code examples according to the three example stubs shown
Create or refactor tests/model_assembly/test_grfn_execution.py to utilize all of the Python code examples
Implement the GrFN3 execution framework
Run the Python code examples with sample input/output. Save those examples to a JSON file that you can load during testing so that you can verify that the GrFN execution is producing the appropriate output for given input.
Run the full pipeline script for each example in the Python code examples with all of the necessary flags to produce the JSON file output for CAST, AIR, GrFN, GrFN dotfiles, and CAG.
This may require changes or corrections to be made in the pipeline that generates these items
Manually inspect the output to ensure that the output is correct
Remove old tests that are no longer necessary for the new pipeline, add any other desired test cases and mark the sensitivity analysis test cases with pytest.mark.skip so that we have a record of them but they will not be caught as failing for this PR.
Overview
The collection of tasks defined below should be all that is needed to prepare the tests that will determine if the
grfn2grometbranch to merge intomaster. All tasks defined should be carried out on thegrfn2grometbranch or a branch from that branch.Useful pointers
tests/data/program_analysis/language_tests/python/<idiom-name>/<test-name>/<test-name>.pytests/conftest.py./pytest.iniscripts/model_assembly/py2grfn.pyTasks
tests/program_analysis/test_python2cag.py,tests/program_analysis/test_cag2air.py,tests/model_assembly/test_air2grfn.py, andtests/model_assembly/test_grfn2cag.pyfor all of the Python code examples according to the three example stubs showntests/model_assembly/test_grfn_execution.pyto utilize all of the Python code examplespytest.mark.skipso that we have a record of them but they will not be caught as failing for this PR.