issues
search
cognitive-catalyst
/
WA-Testing-Tool
Scripts that run against Watson Assistant for K fold validation on training set, testing on blind test, and draw precision curves for comparison.
Apache License 2.0
78
stars
60
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
null safety for intent confidence
#248
andrewrfreed
closed
3 months ago
1
extractConversations breaks if no intent confidence found
#247
andrewrfreed
closed
3 months ago
0
Update testConversation.py
#246
victorpovar
closed
5 months ago
1
failure in testConversation.py class when encountering disambiguation responses
#245
victorpovar
closed
5 months ago
0
#235 optional sample weighting via 'weight' column
#244
andrewrfreed
closed
6 months ago
0
#242 store summary metrics to file
#243
andrewrfreed
closed
6 months ago
0
Capture global accuracy score to file
#242
andrewrfreed
closed
6 months ago
0
#240 global scaled option for confusion matrix
#241
andrewrfreed
closed
6 months ago
1
Scale confusion matrix colors by number of examples
#240
andrewrfreed
closed
6 months ago
0
Export conversation in transcript format
#239
andrewrfreed
closed
6 months ago
0
Update compare-blind.md for typos
#238
andrewrfreed
closed
1 year ago
0
report number of predictions
#237
andrewrfreed
closed
1 year ago
0
Need "number of predictions" in intent metrics
#236
andrewrfreed
closed
1 year ago
0
Ability to "weight" results in blind test scoring
#235
andrewrfreed
closed
6 months ago
0
Support k-folds for Actions-based skills
#234
andrewrfreed
opened
1 year ago
0
Link to Dialog Skill analysis
#233
andrewrfreed
closed
1 year ago
0
pass input columns to output file
#232
andrewrfreed
closed
1 year ago
0
Pass input columns to output file
#231
andrewrfreed
closed
1 year ago
0
fixed NLU mode for older Python versions
#230
andrewrfreed
closed
1 year ago
0
additional v2 updates for notebook users
#229
andrewrfreed
closed
1 year ago
1
clarify Python version needed for NLU
#228
andrewrfreed
closed
1 year ago
0
#215 support for Actions-based logs
#227
andrewrfreed
closed
1 year ago
2
references to external education
#226
andrewrfreed
closed
1 year ago
0
update default version
#225
andrewrfreed
closed
1 year ago
0
#215 support for WA v2 message API
#224
andrewrfreed
closed
1 year ago
2
#216 updates to use NLU instead of NLC, from Andrew Freed and Keith H…
#223
andrewrfreed
closed
1 year ago
1
Does the WA Testing Tool support Watson Assistant API version 2?
#222
thomassuedbroecker
closed
1 year ago
2
phone log enhancements
#221
andrewrfreed
closed
1 year ago
0
Log analytics - enhancements needed for phone logs
#220
andrewrfreed
closed
1 year ago
0
Finished previous PR and added support for disabling SSL
#219
dalcaibm
closed
1 year ago
0
Modernize WA version references
#218
andrewrfreed
closed
1 year ago
0
Add reference to existing Medium articles and YouTube posts to main README
#217
andrewrfreed
closed
1 year ago
0
Reference to NaturalLanguageClassifierV1 should be updated or removed
#216
andrewrfreed
closed
1 year ago
4
Support for new Actions assistants
#215
andrewrfreed
closed
1 year ago
3
Remove or replace NLC function
#214
andrewrfreed
closed
1 year ago
1
Fixed cannot import name 'NaturalLanguageClassifierV1'
#213
thedalewilliams
closed
2 years ago
1
Cannot import name 'NaturalLanguageClassifierV1'
#212
thedalewilliams
closed
2 years ago
0
fix defect re: UTF-8 import
#211
andrewrfreed
closed
2 years ago
0
compare two blind test results
#210
andrewrfreed
closed
2 years ago
0
Compare current and previous blind test run
#209
andrewrfreed
closed
2 years ago
0
fix deprecation warning on asyncio
#208
andrewrfreed
closed
2 years ago
1
Deprecation warning on Python 3.9 & latest dependencies
#207
andrewrfreed
closed
2 years ago
0
progress tracker for long-running tasks
#206
andrewrfreed
closed
2 years ago
0
Progress indicator would be useful during long test phases
#205
andrewrfreed
closed
2 years ago
0
toggle CSV or PKL output
#204
andrewrfreed
closed
2 years ago
0
Log analytics: support export to pandas pickle file
#203
andrewrfreed
closed
2 years ago
0
#201 status indicator during log fetch
#202
andrewrfreed
closed
2 years ago
0
Improve status message in getAllLogs.py
#201
andrewrfreed
closed
2 years ago
0
allow flexible input types
#200
andrewrfreed
closed
2 years ago
0
Allow extractConversations.py to work on a raw JSON file produced by API (not by `getAllLogs.py`)
#199
andrewrfreed
closed
2 years ago
0
Next