jbonda / ml-workflow-pipeline

The work flow of CS-600(Professional software development) Project.Project Title: GUI pipeline for ML models.
0 stars 0 forks source link

[BUG] Hard crash on selecting accuracy score for evaluation. #41

Closed raelewis closed 1 year ago

raelewis commented 1 year ago

Is there an existing issue for this?

Current Behavior

With the Simple Linear Regression model, users can evaluate the model using the accuracy score. This results in a hard crash with the following error: ValueError: Classification metrics can't handle a mix of continuous and binary targets

Expected Behavior

This method of evaluation does not work with this type of model. Maybe remove it as an option or provide an error message stating that this type of evaluation does not work with the model we have selected.

Steps To Reproduce

  1. Navigate through the website process until the training/model selection step.
  2. Select Simple Linear Regression.
  3. Continue navigating the form. We used the default values for hyperparameters.
  4. For model evaluation, select accuracy score and submit.

Environment

No response

Anything else?

No response

jbonda commented 1 year ago

It's a very valid Issue. Thanks for bringing it to our notice. I fixed it by providing some extra information to select a relevant metric according to the selected model.

raelewis commented 1 year ago

The fix worked, thank you!