search

PolyVerifFramework / PolyVerif

PolyVerif AV Validation Suite
https://www.avvc.net
13 stars 4 forks source link

Test synthesis from real data? #4

Open slivingston opened 4 months ago

slivingston commented 4 months ago

In your paper that introduces PolyVerif in IEEE Access (https://ieeexplore.ieee.org/document/10075634), you refer to test synthesis on page 28349 (page 7 of your paper): "Once simulation finds a potential issue, it is useful to be able to recreate the test in a physical environment."

Have you done this in PolyVerif? I am interested in test synthesis besides Scenic. The paper refers to the case of constructing tests from real data, but I did not find any code to do so in this repository.

chavankunal commented 4 months ago

We are developing a 3D digital twin from real-world data and constructing test cases for simulation.

slivingston commented 4 months ago

Can you show me where in the code you are "constructing test cases"?

chavankunal commented 4 months ago

[https://github.com/PolyVerifFramework/PolyVerif/tree/PolyVerif-OSSDC-SIM/Test_Cases] In the Test_Cases directory, you will find a maps folder containing subfolders like CubeTown and BorregasAve. Within these subfolders, test cases are written in Python and Scenic languages according to different validations. You will find both Python and Scenic scripts for these test cases.

slivingston commented 4 months ago

Are these test cases manually created?

Perhaps my original post was not clear. The paper is ambiguous as to whether the tests are generated automatically from real-world data. Therefore, I am asking if the test case generation is automatic (given real-world data), and if so, where is the generation code.