We currently have a tool for reporting on individual models (Quarto) and one for comparing many models (Tableau). However, we don't have a tool for comparing two selected models and doing a "diff".
It would be nice to add something that could look at the % change in performance stats between two models, look at the change in individual property values, and look at how new features have impacted feature importance.
We currently have a tool for reporting on individual models (Quarto) and one for comparing many models (Tableau). However, we don't have a tool for comparing two selected models and doing a "diff".
It would be nice to add something that could look at the % change in performance stats between two models, look at the change in individual property values, and look at how new features have impacted feature importance.
I imagine this could be a Quarto doc to start.