search

plasma-umass / coverup

Automatic AI-powered test suite generator
Apache License 2.0
23 stars 4 forks source link

No increase in code coverage #8

Open jamal-ansary opened 2 months ago

jamal-ansary commented 2 months ago

Hello, The model doesn't save the test units as a .py file when there is no increase in code coverage. it saves them as log file. is there an option to override that?

jaltmayerpizzorno commented 2 months ago

No, currently there isn't, but it would be relatively easy to add. I'm curious, though: how that would be useful?

jamal-ansary commented 2 months ago

i had a python code with bug in it. i also had a unit test that didn't reveal the bug. the coverage didn't increase after prompting with chat gpt, so the test cases weren't saved. when i was reading log file, one of the test cases would be able to detect the bug. Just something that i came across. Any way, congrats for the great work.

jaltmayerpizzorno commented 1 month ago

Thank you :)

I am not quite clear on the situation, though... was the test dropped because it (exposed the bug and) failed, or because it didn't increase coverage?

jamal-ansary commented 1 month ago

because it didn't increase coverage.