#215 support for WA v2 message API

cognitive-catalyst / WA-Testing-Tool

Scripts that run against Watson Assistant for K fold validation on training set, testing on blind test, and draw precision curves for comparison.

Apache License 2.0

78 stars 61 forks source link

Closed andrewrfreed closed 1 year ago

andrewrfreed commented 1 year ago

Supports #215

By providing an Environment ID, you can do a blind or standard test against a Watson Assistant v2 instance.

Known limitations:

Cannot run k-folds mode
Cannot create/delete "temporary" workspaces
Intent names returned by WA are the internal IDs - not intent/action names - therefore additional work is required to construct a ground-truth file.

DCO 1.1 Signed-off-by: Andrew R. Freed afreed@us.ibm.com

lmazzoli commented 1 year ago

@andrewrfreed - These code changes look good. Recommend making the documentation comments consistent on using the environment_id for V2 purposes.

andrewrfreed commented 1 year ago

@andrewrfreed - These code changes look good. Recommend making the documentation comments consistent on using the environment_id for V2 purposes.

Agree, thanks for the comment. Have updated based on your request and will merge based on your approving remarks.