test-fullautomation / robotframework

Generic automation framework for acceptance testing and RPA
http://robotframework.org
Apache License 2.0
1 stars 0 forks source link

Proposal: self test extensions #104

Open HolQue opened 2 weeks ago

HolQue commented 2 weeks ago

Up to now the self test of the Testsuites Management contained some test cases testing functionality that is not located in the Testsuites Management immediately (or not any more), but in the Robot Framework core.

Therefore the following tests should be taken over to the self test of the Robot Framework (if not already available).

TSM_0551
dictUsecase['DESCRIPTION'] = "Robot file contains keyword FAIL"
dictUsecase['EXPECTATION'] = "Test is executed up to position of keyword FAIL; error message; test result is FAIL"

TSM_0552
dictUsecase['DESCRIPTION'] = "Robot file contains keyword UNKNOWN"
dictUsecase['EXPECTATION'] = "Test is executed up to position of keyword UNKNOWN; error message; test result is FAIL or UNKNOWN (depending on the Robot Framework core)"

TSM_0553
dictUsecase['DESCRIPTION'] = "Call of not existing keyword in test code of robot file"
dictUsecase['EXPECTATION'] = "Test is executed up to position of keyword call; error message; test result is FAIL or UNKNOWN (depending on the Robot Framework core)"

TSM_0554
dictUsecase['DESCRIPTION'] = "Incomplete keyword 'FOR' in test code of robot file"
dictUsecase['EXPECTATION'] = "Test is executed up to position of incomplete keyword call; error message; test result is FAIL or UNKNOWN (depending on the Robot Framework core)"

TSM_0555
dictUsecase['DESCRIPTION'] = "Import of not existing library in robot file"
dictUsecase['EXPECTATION'] = "Test is not executed; error message; test result is FAIL or UNKNOWN (depending on the Robot Framework core)"

TSM_0556
dictUsecase['DESCRIPTION'] = "Import of not existing library in robot file"
dictUsecase['EXPECTATION'] = "Test is not executed; error message; test result is FAIL or UNKNOWN (depending on the Robot Framework core)"

TSM_0557
dictUsecase['DESCRIPTION'] = "Assignment of unknown dictionary key in test code of robot file"
dictUsecase['EXPECTATION'] = "Test is executed up to position of invalid assignment; error message; test result is FAIL or UNKNOWN (depending on the Robot Framework core)"

TSM_0558
dictUsecase['DESCRIPTION'] = "Assignment of known parameter to unknown dictionary subkey in test code of robot file"
dictUsecase['EXPECTATION'] = "Test is executed up to position of invalid assignment; error message; test result is FAIL or UNKNOWN (depending on the Robot Framework core)"

TSM_0559
dictUsecase['DESCRIPTION'] = "Robot file with several tests; one test contains keyword FATAL ERROR"
dictUsecase['EXPECTATION'] = "Test suite is executed up to position of keyword FATAL ERROR; error message; test suite result is UNKNOWN; not executed test cases are counted as SKIPPED"

TSM_0600
dictUsecase['DESCRIPTION'] = "Robot file containing several tests, some PASSED (2), some FAILED (3), some UNKNOWN (4)"
dictUsecase['EXPECTATION'] = "Return value of Robot Framework indicates number of FAILED together with number of UNKNOWN tests"

TSM_0700
dictUsecase['DESCRIPTION'] = "Folder with several robot files (6) containing several tests, some PASSED (6), some FAILED (6), some UNKNOWN (6)"
dictUsecase['EXPECTATION'] = "Return value of Robot Framework indicates number of FAILED together with number of UNKNOWN tests"

Check of return values of Robot Framework (especially w.r.t. UNKNOWN state) Check of test results (especially w.r.t. UNKNOWN state)