search

blobcity / autoai

Python based framework for Automatic AI for Regression and Classification over numerical data. Performs model search, hyper-parameter tuning, and high-quality Jupyter Notebook code generation.
Apache License 2.0
175 stars 43 forks source link

Metric Statics #18

Closed Thilakraj1998 closed 3 years ago

Thilakraj1998 commented 3 years ago

Add statistical metric for train model

Metric to utilize in following problem statements:

  1. Regression:

    • R2
    • MSE
    • MAE
    • RMSE

  2. Classification:

    • Precision
    • Recall
    • F1-Score

Enhancement:

Add a function to Model Class named stats , which returns above mentioned metric associated to problem type.

file to ref: 

   https://github.com/blobcity/autoai/blob/main/blobcity/store/Model.py
   https://github.com/blobcity/autoai/blob/main/blobcity/config/tuner.py
   https://github.com/blobcity/autoai/blob/main/blobcity/main/modelSelection.py

calculate appropriate metric on the basis problem type for selected model along with the tuning parameters on train and test split with 80:20 ratio. And store the resulting data in dictionary data structure in Model Class. when stats function is called report/print all the stored stats from the dictionary.

Thilakraj1998 commented 3 years ago

23

Resolved