yanyh15
commented
3 years ago @XinyaoYI Please summarize our discussion for how to adding test cases, including naming convention, folder, here so in the future, those who add tests will follow this guideline.
Nov 2020 meeting notes:
Xinyao: for test cases, we organize them as one folder for each directive that has the cases/reference that test the directive. https://docs.google.com/spreadsheets/d/1u_5snMD2u61PKOszYGJBdMeYA2x73cEFrcHgGP7rXXY/edit?usp=sharing
Xinyao/Anjia/Yonghong: Testing reorganization: one folder per directive. The folder contains test cases, Makefile, reference of each case, etc. test case and their name MUST be properly named so we can find the two easily. E.g. parallel.c, parallel_reference.c. We need a good Makefile in the top level and then in each folder so we can just list the case and their reference file in the Makefile. Check https://github.com/OpenMPToolsInterface/llvm-project/tree/openmp5-gpu/openmp/libomptarget/omptests for how OpenMP LLVM runtime organizes their tests. Create Makefiles structure first based on the llvm openmp in the link, and then experiment with our test cases/reference. Check ROSE test Makefile.am to see how they are using Makefile for that. [A new testing system is implemented. https://github.com/passlab/rexomptest/tree/main/REXCompiler/omptests]
To see the code: https://github.com/passlab/rexomptest/tree/test_xinyao To see the list of all test files(recording the process): https://docs.google.com/spreadsheets/d/1u_5snMD2u61PKOszYGJBdMeYA2x73cEFrcHgGP7rXXY/edit?usp=sharing
For each test cases, we need two references, one for parsing and unparsing, and the other for transformation. Organize the existing test first.