search

caserec / CaseRecommender

Case Recommender: A Flexible and Extensible Python Framework for Recommender Systems
MIT License
471 stars 91 forks source link

Evaluation of CoRec #33

Closed liv1n9 closed 5 years ago

liv1n9 commented 5 years ago

Hi. I'm studying your paper. In Evaluation chapter, table 1, the paper compared RMSE of UserKNN and ItemKNN when applying on original training set and enriched training set. My question is, the unlabeled set taking from original training set for testing is different from the unlabeled set of enriched one. So does it affect the reliability of evaluation? I think the evaluation is reliable if the test sets in all cases are the same. Correct me if i'm wrong.

arthurfortes commented 5 years ago

Not really. You use a random uncollected data set to enrich your original data matrix, whether the samples are in your test suite or not. In the end, its test suite serves to validate how much these enriched matrices work better than those used in traditional approaches.