the ansewer ID of amazon is not in the provided amazon KG

snap-stanford / stark

STaRK: Benchmarking LLM Retrieval on Textual and Relational Knowledge Bases (NeurIPS D&B 2024)

https://stark.stanford.edu/

MIT License

288 stars 34 forks source link

the ansewer ID of amazon is not in the provided amazon KG #10

Open ToneLi opened 3 months ago

ToneLi commented 3 months ago

Hi , Could you help us to check why the answer id in Amazon is not the the provided amazon KG file? for example, answer id 16. thanks!

ToneLi commented 3 months ago

and there are two relations 0: also_buy and 1: also_view in the provided file. why in the paper stark, table 2 shows there are 3 relation types?

Wuyxin commented 3 months ago

Hi,

Please make sure you use our most recent SKB, we updated a lot from our previous version. Let me know if you still meet the same problem!

RE relations: Apologize for the confusion. We further added two relation types to STaRK-Amazon therefore there are 5 relation types in total now. Please refer to https://stark.stanford.edu/dataset_amazon.html for the most updated data description, thanks!