search

cognitive-catalyst / WA-Testing-Tool

Scripts that run against Watson Assistant for K fold validation on training set, testing on blind test, and draw precision curves for comparison.
Apache License 2.0
78 stars 60 forks source link

Capture global accuracy score to file #242

Closed andrewrfreed closed 9 months ago

andrewrfreed commented 9 months ago

Currently summary metric is only displayed on screen

Wrote intent metrics output to test1.csv. Includes 102 correct intents in 134 tries for accuracy of 0.76.
Should also save to file like this: correct total accuracy
102 134 0.76