Closed msampathkumar closed 1 month ago
SDK is updated! updating requirment.txt file
Metrics are working with
from vertexai.preview.evaluation import EvalTask, MetricPromptTemplateExamples
metrics=[
MetricPromptTemplateExamples.Pointwise.SUMMARIZATION_QUALITY,
MetricPromptTemplateExamples.Pointwise.GROUNDEDNESS,
MetricPromptTemplateExamples.Pointwise.VERBOSITY,
...
...
],
This looks more new SDK changes. To use MetricPromptTemplateExamples.Pairwise
metrics, the reference model is required. To be sure I am checking with developer, who worked on this recently.
Description
For context caching - create code samples, updating the sample arguments to use
display_name
. This is a newly added SDK feature.Fixes: b/357634471, b/362459779
A few lint updates are added by Owlbot.
Note: Before submitting a pull request, please open an issue for discussion if you are not associated with Google.
Checklist
[x] Tests pass:
nox -s py-3.9
(see Test Environment Setup)[x] Lint pass:
nox -s lint
(see Test Environment Setup)[x] Please merge this PR for me once it is approved