Enable More Transparency in Model Training

osslab-pku / gfi-bot

[Working in Progress] ML-powered 🤖 for finding and labeling good first issues in your GitHub project!

https://gfibot.io

GNU General Public License v3.0

24 stars 5 forks source link

Enable More Transparency in Model Training #35

Open hehao98 opened 2 years ago

hehao98 commented 2 years ago

We need to show more information in frontend about the model training and evaluation results to users, showing:

performance of each project, trained on what kind of dataset (aggregated as a table)
XGBoost feature weights

hehao98 commented 2 years ago

This maybe can be extended into a dashboard for us to check whether every part of GFI-Bot is currently working (observability is a key quality metric for any software system).

hrz6976 commented 2 years ago

performance of each project: implemented, should be working again when we fix the glittering issue on the home page
dataset table: sorry but I have no idea how to make these tons of data look informative
showing feature weights: simple to implement, but we need to clarify what these metrics are (else nobody knows what's rpt_gfi_ratio)