plasma-umass / coverup

Automatic AI-powered test suite generator
Apache License 2.0
25 stars 4 forks source link

CoverUp, cover-up thyself. #3

Closed emeryberger closed 2 months ago

emeryberger commented 3 months ago

Ran coverup on itself (using OpenAI), increasing test coverage from 41.1% to 59.8%.

Initial coverage: 41.1%
Prompting openai/gpt-4-1106-preview for tests to increase coverage...
(in the following, G=good, F=failed, U=useless and R=retry)
100%|████████████████████████████████████████████████████████████████████| 44/44 [02:44<00:00,  3.75s/it, usage=119755+38921, G=21, F=93, U=3, R=0]
Checking test suite...  tests ok!
End coverage: 59.8%