irecsys / CARSKit

Java-Based Context-aware Recommendation Library
https://carskit.github.io/
GNU General Public License v3.0
124 stars 53 forks source link

MAE and RMSE for SLIM #14

Closed huyenntn closed 5 years ago

huyenntn commented 6 years ago

I configured tem.ranking=off -topN 10 but results of SLIM was still Pre, Rec,... How can I get MAE and RMSE values?

irecsys commented 6 years ago

SLIM based approaches are top-N recommendation algorithms. They cannot be evaluated by MAE or RMSE

On Sun, Dec 17, 2017 at 02:48 Huyenntn notifications@github.com wrote:

I configured tem.ranking=off -topN 10 but results of SLIM was still Pre, Rec,... How can I get MAE and RMSE values?

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/irecsys/CARSKit/issues/14, or mute the thread https://github.com/notifications/unsubscribe-auth/AHDB50lNP9jRYpBtzDHxoRQUXWXkVAiPks5tBDOigaJpZM4REdhr .

-- Sent from Gmail Mobile

huyenntn commented 6 years ago

Can you tell me what the config "-minlenu 2 -minleni 2" mean in usersplitting, itemsplitting and uisplitting algorithms. Thankyou very much!

irecsys commented 6 years ago

Let's take item splitting for example, ratings canbe split into two sets: weekend and weekday. Next, we are going to use statistics to evaluate whether there is significant different in ratings in these two contexts

The minlenu defines the minimal length of the set. If the size is too small, the result by statistic is not reliable

In other words, if you increase the minimal length, the user or item will be split when the two sets meet the length requirement and pass the significance test

On Thu, Dec 21, 2017 at 15:23 Huyenntn notifications@github.com wrote:

Can you tell me what the config "-minlenu 2 -minleni 2" mean in usersplitting, itemsplitting and uisplitting algorithms. Thankyou very much!

— You are receiving this because you commented.

Reply to this email directly, view it on GitHub https://github.com/irecsys/CARSKit/issues/14#issuecomment-353308137, or mute the thread https://github.com/notifications/unsubscribe-auth/AHDB557RY4YRpYKM7WE-s30WuemViYrkks5tCiqhgaJpZM4REdhr .

-- Sent from Gmail Mobile

huyenntn commented 6 years ago

Thankyou and sorry to bother. I have another question. When I used DePaulMovie dataset with UserKNN. It's is a traditional recommender system. Why the context still existed in the result. And the second question is what does "-lc1 -lc2 and reg.lambda=0.0001 -c 0.001" in file config mean?

irecsys commented 6 years ago

If u run userKNN, it will make predictions without considering context

For lc parameters, you need to read the paper or source codes

On Thu, Dec 21, 2017 at 20:06 Huyenntn notifications@github.com wrote:

Thankyou and sorry to bother. I have another question. When I used DePaulMovie dataset with UserKNN. It's is a traditional recommender system. But but the context still existed in the result. And the second question is what does "-lc1 -lc2 and reg.lambda=0.0001 -c 0.001" in file config mean?

— You are receiving this because you commented.

Reply to this email directly, view it on GitHub https://github.com/irecsys/CARSKit/issues/14#issuecomment-353366131, or mute the thread https://github.com/notifications/unsubscribe-auth/AHDB5zeRnShdjk4GK2zLT6NmtbfuJ1hJks5tCmz1gaJpZM4REdhr .

-- Sent from Gmail Mobile

huyenntn commented 6 years ago

For example with predictions in UserKNN-top-10-items fold [1].txt: 1003, companion:alone;location:cinema;time:weekday: (tt0315733, 2.4684935), (tt0109830*, 2.2845337), (tt0111161, 2.2583814), (tt1375666, 2.0370011), (tt0441773, 1.9667363), (tt0268380, 1.9145375), (tt0266543, 1.9062306), (tt1478338, 1.8835531), (tt0125439, 1.8686336), (tt2096673, 1.8268628). It contains the context

huyenntn commented 6 years ago

And if it doesn't use the context, a vector (userid, itemid) may be duplicated. How did you solve it?

irecsys commented 6 years ago

We use average rating for user item pair

On Thu, Dec 21, 2017 at 21:17 Huyenntn notifications@github.com wrote:

And if it doesn't use the context, a vector (userid, itemid) may be duplicated. How did you solve it?

— You are receiving this because you commented.

Reply to this email directly, view it on GitHub https://github.com/irecsys/CARSKit/issues/14#issuecomment-353384203, or mute the thread https://github.com/notifications/unsubscribe-auth/AHDB58VtEB-8dRsUPk7qzvefcHBqkJcYks5tCn2KgaJpZM4REdhr .

-- Sent from Gmail Mobile

huyenntn commented 6 years ago

Can you give me the best config content for cslim_mcs algorithm with movie depaul data. I try it but evaluation value too bad.

irecsys commented 6 years ago

I don't have that at hand. For SLIM based algorithms, they are sensitive to initializations and running parameters. You may need to carefully to tune up the parameters

On Sat, Dec 23, 2017 at 11:17 Huyenntn notifications@github.com wrote:

Can you give me the best config content for cslim_mcs algorithm with movie depaul data. I try it but evaluation value too bad.

— You are receiving this because you commented.

Reply to this email directly, view it on GitHub https://github.com/irecsys/CARSKit/issues/14#issuecomment-353708799, or mute the thread https://github.com/notifications/unsubscribe-auth/AHDB5xpZYXAcWJ4nT33ObrqPViUqExJdks5tDJPogaJpZM4REdhr .

-- Sent from Gmail Mobile

huyenntn commented 6 years ago

Hello Yong Zheng. You still haven't answered my question. UserKNN make predictions without considering context. Why the context still existed in the result? Example of the result: https://i.imgur.com/kiLX9eg.png

irecsys commented 6 years ago

The outputs include contexts for each line. But as I said previously, userknn will be run without considering contexts

On Sat, Dec 30, 2017 at 06:12 Huyenntn notifications@github.com wrote:

Hello Yong Zheng. You still haven't answered my question. UserKNN make predictions without considering context. Why the context still existed in the result? Example of the result: https://i.imgur.com/kiLX9eg.png

— You are receiving this because you commented.

Reply to this email directly, view it on GitHub https://github.com/irecsys/CARSKit/issues/14#issuecomment-354543022, or mute the thread https://github.com/notifications/unsubscribe-auth/AHDB5yfYxNjtAEXRZKMj40hvFoqyqrlvks5tFii_gaJpZM4REdhr .

-- Sent from Gmail Mobile