reimplementation of heldout-test evaluation structure

squaresLab / Darjeeling

Language-independent, search-based program repair -- just your cup of tea! ☕

Apache License 2.0

28 stars 10 forks source link

reimplementation of heldout-test evaluation structure #302

Open pdreiter opened 1 year ago

pdreiter commented 1 year ago

based on @ChrisTimperley 's feedback issue #300

Enables a new CLI interface (darjeeling evaluate)
tested, but seeing some issues with test timeouts (Currently, ResourceUsageTracker(limits=None), so I may need to add back in this from the configuration)

pdreiter commented 1 year ago

@ChrisTimperley - just finished additional testing, 'tis working nicely. I will push the butrs changes so you can check it out.

pdreiter commented 1 year ago

@ChrisTimperley - errors/warnings identified by tox have been cleaned up and repair functionality looks good. assess passes, so you're free to review the changeset.