Tests for PLUM - Githubissues

24anisha / plum

0 stars 0 forks source link

Tests for PLUM #4

Open 24anisha opened 1 month ago

24anisha commented 1 month ago

Write tests to evaluate PLUM's correctness and success across all languages. Some good tests include:

Give a trivial test (ie a test that just asserts True) to run_generated_test and confirm it passes.
Take a specific repo + commit and ask PLUM to list all the functions
Take a specific repo + commit and ask PLUM to run the test suite and make sure the same tests pass and fail
Confirm that PLUM determines the correct test framework of a given repository

As many tests as you can write will be helpful.