brmson / dataset-sts

Semantic Text Similarity Dataset Hub
715 stars 206 forks source link

Clarification needed for pearsonobj function . #45

Open BAJUKA opened 5 years ago

BAJUKA commented 5 years ago

In the pearsonobj function (implemented in objectives.py) , class to score conversion is done on both y_true and y_pred and it is used as the loss function for the sts data set. But in sts data set the true values are floating point numbers so is it necessary to do class to score conversion(for y_true) here? If I am going wrong somewhere could you clarify the approach in pearsonobj you are using in context of sts dataset.