capitalone / rubicon-ml

Capture all information throughout your model's development in a reproducible way and tie results directly to the model code!
https://capitalone.github.io/rubicon-ml/
Apache License 2.0
129 stars 34 forks source link

Adding MetricListComparisonDataSource #466

Closed jeh362 closed 3 months ago

jeh362 commented 3 months ago

closes: #62


Description Issue: Currently we are trying to build an extension for serving visualizations through a Juptyer lab extension. To do this we want to include visualization information in the catalogs. Initially, we created a base visualization data source similar to the existing one for projects and experiments. Now we need to create a concrete implementation for Metric List Comparison visualizations.

Solution: For this issue, we added a new MetricListComparisonDataSource that is going to extend VizDataSourceMixin. We will read in the catalog data and metadata from the passed arguments . Then _get_schema creates a Metric List Comparison visualization and sets it as the visualization_object attribute.

Changes

Updated viz.py within the intake_rubicon folder. This file holds the code for the new MetricListComparisonDataSource. Updated the __init__ function within the intake_rubicon folder to now be able to include MetricListComparisonDataSource for module importing purposes. Updated rubicon_ml/viz/publish.py to take in a MetricListComparison as a visualization object Updated the setup.cfg file to include the MetricListComparisonDataSource as an Intake driver. Updated test_viz.py to include a MetricListComparisonDataSource test method as well. Updated test_publish.py to include a MetricListsComparison visualization object as well. Updatedmetric_lists_comparison.py to fix certain typing errors.