search

oracle / accelerated-data-science

ADS is the Oracle Data Science Cloud Service's python SDK supporting, model ops (train/eval/deploy), along with running workloads on Jobs and Pipeline resources.
https://accelerated-data-science.readthedocs.io/
Universal Permissive License v1.0
87 stars 43 forks source link

Add new metrics - Perplexity & Text Readability. #919

Open amitkrprajapati opened 2 months ago

amitkrprajapati commented 2 months ago

Summary

This PR implements support for two new Gen AI metrics - Perpelexity & Text Readability.

Changes

  1. In ads/aqua/evaluation/evaluation.py - Add two new metrics perplexity_score & text_readability.
oracle-contributor-agreement[bot] commented 2 months ago

Thank you for your pull request and welcome to our community! To contribute, please sign the Oracle Contributor Agreement (OCA). The following contributors of this PR have not signed the OCA:

To sign the OCA, please create an Oracle account and sign the OCA in Oracle's Contributor Agreement Application.

When signing the OCA, please provide your GitHub username. After signing the OCA and getting an OCA approval from Oracle, this PR will be automatically updated.

If you are an Oracle employee, please make sure that you are a member of the main Oracle GitHub organization, and your membership in this organization is public.

vikasray0208 commented 2 months ago

LGTM

mrDzurb commented 3 weeks ago

This PR is not required anymore. The metrics were moved to the service config.