RIOT-OS / RobotFW-tests

Includes tests for RIOT based on the Robot Framework
GNU Lesser General Public License v2.1
4 stars 13 forks source link

Use output xunit script #76

Closed pokgak closed 4 years ago

pokgak commented 4 years ago

This PR changes the build system to use the output_to_xunit.py script from #75. The script is also changed to detect Record Property tags in nested deeper in the output, making the parsing more robust. The robot-test command is modified to specify only the top directory of the RF tests e.g. (tests/) to make sure that the resulting output.xml maintains the directory structure that we defined.

Testing

Run the instruction in the README. In the resulting test_xunit.xml a new testcase Record using keyword is added.

Expected:

<testcase classname="Example Testsuite.Example Test" name="Record using keyword" time="0.002">
    <properties>
        <property name="LONG_STRING" value="LSSDDDJDLJFLJSFDEJSYKLSLSDSKLSDEJFJKYDKJKJHYLDEFDDJDHSHESLDLJJFKKJFKLKDLJDJKEKJDLHSHSJKJKYLJDDDSEYHKSSSJYLDDKFDDKSDSKKDKDSDJFLKKEYDJSLSJKFSKLDLKJJKJEYJSDLKKKFSEEJKFJKSFDLHKDLSSJSSHDDYDSJKLSEYKKFLJFDKJSDFDEEDSSDLDDHHYHHLDJHKJDJSJDYLSSDLJDFYFDKSFSFKLKKHSSKFKJHJDSKSSJKYDSLKSDJHLYFKYJSDFLJKFDHFDDSHFLSDFSEFSDLSESJDLSLDYEJFEDHDJKKDKDSFLLKJKEJLSFEDJJSLDSKSLKKDJDKSHKDDJLJFDDSLHKHFKYJJJFLDLEEYJJYFHLJDKDKSJFDSEKDFJDDEDKYSHKJYDHJJLEKDLJSDSDJKDKSJSSJYKFDYYDLLYSEKLSEHDYFLKKJKKLSSFSSSSLLFDFFFESLYDDFYDYEYDLDDDFFJKESJDDLJKJJKHSJHHHSDSDDSDFDYSLLDJLELLJSDFSYYYEDDEDSLKLHDYSEDDDDFJDDYDSYHDLJJEJJLJHJDFYDDKDKLDEJKESKHDDJJJYFJKHHSLKLJYSDDDDDDLDKDDJKDDSLDJKHFKDSSDDLEFDEDJJLEDFDKLJJLDJSDSSFKLKLDSYDYLDYLYLHLEYEYJLJLYKYSDLJDJSYYJDEKDYHKHYDHHJEYFFFDHDDDSDJSFDSHSDDKJHFFDDDKLFYLDFDHDLEJSSHYDYFDKJKYLFLLLYSSSJDDSDJJJFJSKYSKLSHSLJHFYKDJDDDKDKKJHDHYJDSEFSKHSLJHEDJLYLJJSDLHLLSLDKLHKJYYYDHLDDFDKKDFDJKJJDKFSKEJHFHSLJKLFSKJSSJSKKYEJKSKKHSESEYSFHSESJSDKLSLSLSKFJDKJDSSYSJSDLKKSEEDSKKDFDLDSLJYEFLYDKDJDJLDHJFHKKSFKDYDFDSDKKSJS" /> 
    </properties>
</testcase>

Without https://github.com/RIOT-OS/RobotFW-tests/commit/121a52093fad99f77e897105c537bd4a1b7c3089, the output will not have any properties:

<testcase classname="Example Testsuite.Example Test" name="Record using keyword" time="0.002" />
MrKevinWeiss commented 4 years ago

There are some differences, specifically in the skipped message. However, the message is not being used and isn't planned in the roadmap so I think we can leave it out.