search

oracle / accelerated-data-science

ADS is the Oracle Data Science Cloud Service's python SDK supporting, model ops (train/eval/deploy), along with running workloads on Jobs and Pipeline resources.
https://accelerated-data-science.readthedocs.io/
Universal Permissive License v1.0
87 stars 43 forks source link

Add config validation and telemetry #872

Closed VipulMascarenhas closed 4 months ago

VipulMascarenhas commented 4 months ago

Description

This PR adds the the following changes:

  1. Validate model_type in config.json: If custom metadata has this attribute, then check if config.json is available in the user bucket where artifacts are loaded from.
  2. Bug fix: after registering model, model card should return the readme from the user bucket instead of verified model bucket.
  3. Record telemetry information after registering models.
  4. Updated Unit Tests.

Unit Tests

> python -m pytest -q tests/unitary/with_extras/aqua/test_model*.py
==================================== test session starts ====================================
platform darwin -- Python 3.8.18, pytest-7.4.0, pluggy-1.0.0
rootdir: /Users/vmascarenhas/workspace/git/accelerated-data-science
configfile: pytest.ini
plugins: Faker-24.9.0, anyio-4.2.0
collected 24 items

tests/unitary/with_extras/aqua/test_model.py .................                        [ 70%]
tests/unitary/with_extras/aqua/test_model_handler.py .......                          [100%]

==================================== 24 passed in 3.60s =====================================