JohnSnowLabs / langtest

Deliver safe & effective language models
http://langtest.org/
Apache License 2.0
496 stars 39 forks source link

Improving the Importing of Edited Testcases into Harness #1021

Closed chakravarthik27 closed 4 months ago

chakravarthik27 commented 4 months ago

Description

Currently, the Harness system imports test cases from external sources, focusing primarily on robustness and bias categories. This process involves filtering and selectively integrating these specific categories, potentially omitting the integration of other crucial test case categories such as accuracy, fairness, performance, etc. The goal of this improvement is to enhance the import_edit_testcases method to allow for more versatile handling of test case categories during the import process. This will enable the incorporation of a broader range of test cases, enhancing the comprehensiveness and effectiveness of our testing suite.