Closed 97z closed 3 weeks ago
Hi 👋!
Thank you for your interest! For the Amazon book dataset, we first filter interactions with the rating score of 3. To manage the dataset size, we uniformly sample 20% (25% for Yelp/Steam) of the users, as it was affordable for us to conduct profiling for a few dozen dollars using the GPT-3.5-Turbo
API at that time. The good thing is that it is now much more feasible with a cheaper OpenAI API :)
We then apply a 10-core approach to obtain the initial datasets. Following that, we utilize multi-thread processing, as outlined in our code, to conduct profiling and text embedding encoding. Ultimately, we remove any users or items that were not successfully profiled or encoded (sometimes due to internet issues) and format the data into usr_prf.pkl
, usr_emb_np.pkl
, itm_prf.pkl
, and itm_emb_np.pkl
.
I hope the above information is helpful for you :)
Best regards, Xubin
Hi 👋!
Thank you for your interest! For the Amazon book dataset, we first filter interactions with the rating score of 3. To manage the dataset size, we uniformly sample 20% (25% for Yelp/Steam) of the users, as it was affordable for us to conduct profiling for a few dozen dollars using the
GPT-3.5-Turbo
API at that time. The good thing is that it is now much more feasible with a cheaper OpenAI API :)We then apply a 10-core approach to obtain the initial datasets. Following that, we utilize multi-thread processing, as outlined in our code, to conduct profiling and text embedding encoding. Ultimately, we remove any users or items that were not successfully profiled or encoded (sometimes due to internet issues) and format the data into
usr_prf.pkl
,usr_emb_np.pkl
,itm_prf.pkl
, anditm_emb_np.pkl
.I hope the above information is helpful for you :)
Best regards, Xubin
I get it! Thank you for your reply!
Hi 👋, Thanks for your great work! I try to run your code on my own dataset. For fairness comparison, can you upload the whole data processing code? I find the user number in raw data is more than 10999 even when I filter by 3-cores. And how did you generate usr_prf.pkl, usr_emb_np.pkl, itm_prf.pkl and itm_emb_np.pkl? Thank you for any reply!